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i     TO  THE  EDUCATIONAL  RESOURCES 
INFORMATION  CENTER  (ERIC)." 


•  '    '  '     .  Introduction  ^  :  * 

Gpncern  for.  the  improvement  of  American  education  is  vJidely  evident 
t6day.    The  National  Commission  on  Excellence  in  Education  (Gardner  et  al.,  - 

1983)  stated  bluntly  that''"a  tide  of  mediocrity  has  devastated  public 

^  '      •  •  '  ■  •  '  ■  '      ■  ■  • 

education",'  ind  suggested,  among  other  things,  that  educators  must  demand 

.  ft. 

^the  best  effort,  and  performance  from  all  students  regardless  of  their 
backgrounds  and 'orientation.  ^  *  ' 

^     If  educators  are  to' demand  the  best  efforts  from  all  students,  we^  must 
learn  .more  about  cognitive  styles.    Cognitive  styles,  especially  field  ; 
dependence/field  independence  (FD/FI) ,  have  recently  received  much 
attention,  probably  because  they*  have  been  related  to  many  le^arning  - 
abilities  and  activities.    According  to  Aus^urn  and  Ausburn '(1978') ,  almost 
no  research  has  been  conducted  on  the  relationship. 'between  cognitive  styles 
and  instructional  designs..    In  addition,  cognitive  styles  have  not  been  * 
conceived  and  studied  as  a  single  entity.    Rather,  a  number  of  different 

c  .  *  •  »  ■  -    ■  ■" 

factors  or  dimensions  of  <:ognitive  styles  have  been  identified  and .  subjected 
to  systematic  theoretical  and  empirical-  examination  (Ausburn  and. Ausburn, 
1978).    Therefore,'  Sadies  desig-ned  to  investigate  these  rel ationships  may 
be  useful  to  instructional  developers  and  designer's.  .  •  r 

Related  Research  '  —  .* 

V/,  •  ^ 

Cognitive^   Styles       .    '      ^  ■    ■  ^  .   .  . 

"  ^  ■  ^  ■  '      ■  .  ■  \ 

The  concept  of  cognitive  style"  refers  to  psychologice^l  ; dimensions  that 
represent  cdns^istencies  in'  an  individuaVs  manner  ^of  acquiring  and 
processing  information  jAusburn  and- Ausburn,  1978).'    Several  learning  styles. 
.  have  bee^n  identified^.    Each  style  seems  ta'^'be  related/to  how  ;the  individual  . 

•■.•.•>  •  *  .3 

-       ■■  •>   •  I 

processes  and  I'e'afn's  information.    An  often  studied  learning  style  by 


educational  technology  researchers,  because  of  its  relationship  to  mediated 
'     •■  instruction,  is  field  dependence/field  independence  (FD/FI).    Witkin  and  his 

collaborators  (19711  discussed  FD/FI  and  indicated  that  the  FD  person  had 
7" ^'  difficulty  locating  geometrical  figures  in  a  complex  pattern.    The  FI 

„      ■  person,, ^n'/fie  other  hand,  did  not  have  s,uch  difficulty  locating  the  same 

figures.  .  - 

*     Color  Realism  and  Visualized  -Instruction  -       \  - 

The  question  of  whether  color  or  black  and  white  images  have  an  effect 
on  increasing  the  performances  of  an  .individual'  has  been  investigated  by 
several  researchers.    In  summary,'  a  number  ofVudies  relating  to  the  color 
.   variable.  Otto  and  Askov  (1968)  concluded  that  "the  cue  value  of^color  in 
learning  is  still  essentially'unclear."    Rudisill  (1952)  indicate^  that 
students  preferred  Ho  view  colored  instructional  materials,  but  Katzman  and 
■  Nyenhuis- (19720  found  that  color  did  not  improve  the  learning  of  materials. 
Travers,  quoted  in  Kemp  (1975  p.  23)  concluded  that  while  color  adds  to  the 
attractiveness,  of  instructional  materials,  black  and  white  illustrations  ^ 
'  '         "    were  just  as  effective  for  instructional  purposes,  except  when  the  learning 
involved  color  discrfmination.  ..      ..  -  " 

Realism  theories,  according  to  Dwyer  (1976),  are  based  on  the 
"      .  assumption  that  learning  will  be  more  complete  as  the  number  of  cues  ir\  the 

..      learning  situation  increases.    Most  instructional  materials  available  today 
.  are  published  in.  colo-.    An  import-ant  research  question  available  today  may 
'  not  be  whether  the  presence  of  color  in  an  illustration  promotes  learning 
but' whether  it  may  actually  dSer  or  hinder  learning  in  a  FD  or  FI  student. 
Does  the  presence  of  color  make  the  illustration  more  complex?    Since  FD/FI 
is  correlated  strongly  with  one's  ability  to  sift  through  a  series  of 
•        ■         possible  solutions  and  select  the  bes+  solution  to  a  problem,  in  terms  of 

using  instructional  materials  with  varying  amounts  of  visual  stimul i  for 

A 
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instructional  purposes,  FD/FI  and  time  on  task  could  affect  one's  ability  to 
distinguish  and  organize  the  relevant  cues. 

c      •  '  '• 

Amount  of  tme  and  learning 

The  amount  of  time  used  to  process  information  may  also  interact ^*ith 
cognitive  style  and  stimuli  vari abil ity  to  affect  learning.    Carroll  (1963) 
regarded  time  as  the  central  variable  in  school  learning,  and  asserted  that 
students  differ  in  the  amount  of  time  they  need  to  learn  a  given  set  of 
materials  to  some  set  criterion.    Anderson  (1973),  Arlfn  (1973),.  and.Ozcelik 
(1973)  studied  the  amount  of  time  students  spend  in  active  learning  and 
found  that  the  amount  of  time  spent  on  learning  were  highly  predictive  of 
the  learning  achievement  of  the  students. 

Statement  of  Hypotheses  ,  - 

The  following  hypotheses  were  generated  and  tested  .at  the  .05  and  .01 
levels  of  confidence:  .    .  ' 

1.  There  is  no  significant  difference  in  posttest  scores 

between  FD  and  FI  Ss  treated  with  color,  B/W  and  no  illustrations. 

2.  There  is  no  significant  relationship  between  FD  and  FI,  time  on 
task  and  posttest  scores  of  Ss.  in  the  treatment  groups. 

Q 

Subjects  : 

Eighty-five  freshman  students  in  the  Iowa  State  University  psychology 
pool  agreed  to  participate  in  all.  aspects  of  the  study.  Thirty-eight 
students  of  the  original  132  who  participated  in  the  Group  Embedded  Figures 
Test  (GEFT)  chose  not  to  participate  in  the  total  study.    In  addition,  nine 
students  were  dropped  because  of  color  blindness'.    Their  FD/FI  scores  were 
not  significantly  different  from  the  eighty-five  .students  who  completed- the 
study. 
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Instruments  • 

The  major  instruments  for  this  study  consisted  of  the  GEFT  (Witkin  et 
al.',  1971),  color  blindness  test  (Dvorine,  1953),  and  a  pretest  ahd  posttest 
(Dwyer,  1967)  programmed  on  the  Apple  II  microcomputer.    Since  the  pretest 

".7" 

and  the  posttest  were  gtven  on  the  same  day,  the  pretest  was  created  to  be 
more  general  in. nature  and  would  not  contaminate  the  posttest  results,  The 
pretest  was  used  solely. to  establish  the  uniformity  of  the  entry  level  of 
the  Ss,  and  the  posttest  was  used  to  determine  the  effects  of  stimuli 
variability  and  time  on  task.    The  computer  was  programmed  to  display  the 
questions,  record  the  answers  and  time  from  initial  display  until  the 
subject  responded  to  the  questions. 

Treatment  Groups 

The.  treatment  groups  were  established  as  follows.:    Group  one  Ss  were 
treated  with  programmed  instruction  supplemented  by  detailed,  shaded 
drawings  of  the  human  heart  in  color.    The  subjects  also  used  color  drawings 
of  the  heart  to  answer  the  posttest  questions.    Group  two  Ss  had  the  same 
treatment  given  to  the  color  group  with  the  only  difference  that  B/W  visuals 
were  used  instead  of  color  visuals.    Group  three  (control  group)  Ss  were 
treated  with  only  the  instructional  script  without  visuals,. 

All  the  subjects  answered  the  pretest  (using  the  computer)  before  the 
experimental  treatment.    Finally,  all  the  Ss  were  asked  to  answer  the 
p^osttest  questions  using  color  or  B/W  visuals  and  the  computer  as  soon  as 

c 

they  finished  reading  the  instructional  script. 

Data  Analysis. 

The  Statistical  Package^ for  the  Social  Sciences  (Nie,  Hull,  Jenkins,^ 


Steinbrenner  and  Bent,  1975)  and  the  SPSSX  (Nie  et  al.,  1983)  were  used  in 
the  analysis  of  the  data.    WYLBUR  was  used  to  provide  on-line  interactive 
text  editing  capabilities  that  allow  the  user  to  create,  change,  store  and 
display  text.    The  system  also  provided  services  for  submitting  jobs  for 
batch  processing  and  retrieving  the' resulting  output.    The  analysis  of 
variance  (ANOVA)  and  Pearson  product-moment  correlation  was  used  for  data 
analysis.  t  , 

Results 

.    FD/FI  scores  were  established  for  each  S,  and  all  the  Ss  were  then 
assigned  to  FD  and  FI  groups.    Ss  scoring  between  1-11  were  classified  as 
FD,  and  those  in  the  12-18  range  were  classified  as  FI  as  recommended  by 
Witkin  et  al .  (1971).  -Because  scores  were  skewed  toward  FI,  that  group  had 
a  much  larger  size  -  23  FD,  and  62  FI  Ss. 

Pretest  scores  listed  in  Table  1,  indicated  that  the  cell  means  were 
pretty  much  the  same.    Analysis  of  variance  (Table  2)  enabled  the  researcher 
to  conclude  that  no  significant  differences  existed  in  either  rows  or 
columns.    It  was  assumed,  therefore,  that  groups  were  relatively  equal  at 
the  start  of  the  experiment. 

Posttest  scores  are  listed  in  Table  3.    Analysis  of  variance  (Table  2) 
indicated  that  no  significant  differences  appeared  between  FO/FI  groups  and 
that  no  significant  interactions  were  present.    However,  significant 
differences  were  noted  among  treatment  groups.    Further  analysis  confirmed 
that  the  two  experimental  groups  had  significantly  higher  mean  posttest 
scores  than  the  control  group.    This  had  been  anticipated  and  is  not 
considered  important,  since  the  posttest  items  dwelled  heavily  on  the  visual 
aspect  of  the  instructional  materials.    What. is  important,  however,  is  that 
the  means  of  the  two  experimental  groups  were  not  significantly  different 
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from  each  other.  "  „ 

Pearson  product "moment  correlations  are  reported  in  Table  4.  The 
correlations  reported  reveal  that  FD/FI  and  color  treatment  group  had  a  low 
positive  correlation  (r=0..35,  p=0.03).  ^ 

ANOVA  of  posttest  time  by  FD/FI  with  treatment  groups  (Table  5)  also 
yielded  a  significant  F-ratio  (F=3.60,  Significance  of  F  =  .03).  This 
indicated  that  the  treatments  accounted  for  the  difference  in  posttest  time. 

9 

Conclusion 

.  The  data  on  Table  4  indicate  that  the  presence  of  color  in  the 
illustration  had  minimal  effect  on  posttest  scores.    These  findings  are 
consistent  with  those  of  Katzman  and  Nyenhuis  (1972)  and  Travers  (cited  in  , 
Kemp,  1975).    Moreover,  there  appears  to  be  no  evidence  to  indicate  that  FD 

*^  . 

"  / 

Ss  are  adversely  affected  by  the  presence  of  color.    This  is  in  consonance 
with  the  findings  reported  by  Hazib  (1979)  that  no  significant  difference 
exists  between  FD  and  FI  Ss  in  an  experiment  using  realisti^c  and 
non-realistic  illustrations.    The  findings"  al so  agree  with  those  of  Dwyer 
(1976)  that  the  stimv'i  variability  is  not  a  reliable  predictor  of  learning 
efficiency.    With  regards  to  time  on  task,  it  was  concluded  that  students 
exposed  to  instructional  materials  without  visuals  need  more  time  to  process 
and  learn  new  information. 

,  Important  implications  concerning  the  use  of  color  and  B/W  with  Ss 
possessing  different  learning  styles  could  be  established  based  partly  on 
the  results  of  this  study.    Thus,  there  is  need  for  more  experiments  to 
determine  whether  the  other  variables  in  Dwyer's  (1967)  realism  continuum 
have  an  effect  on  cognitive  styles.    The  use  of  the  Apple  II  microcomputer, 
as  used  in  the  present  study,  also  needs  further  investigation. 
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TABLE  1 

Cell  Means  of  Pretest  scores  by  Field  Dependence/  Field  Independence  and  Treatment  Groups 


Color  treatment 

B/W  Treatment 

Control  , 

Field  Dependence 

13.43 

(7) 

12.20 

(10)  . 

13.17 

.  (6) 

Field  Independence 

12.59 
(22) 

13.16 
(19) 

\ 

13.52 

(21) 

Group  Mean 

.12.79 
(29) 

\ 

12.83  ^ 
(29) 

13.44 
(27) 

Field  Dependence        =  12.83 

(23) 

Field  Independence     =  13.08 

(62) 

TOTAL  POPULATION        =    .  13.01 

(85) 
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.  •  *     Table  2  -  , 

Analysis  of  Variance  of  Field  Dependence/Field  Independence  and  Posttest  Scores 

in  the  Three  Treatment  Groups 


Source  of 
Variation 

Sums  of 
Squares 

DF^ 

Mean  Square 

F 

Significance  of 

Main  Effects 

202.98 

3 

67.66" 

.3.52 

0.02** 

FD/FI 

13.10 

1 

13.10 

0.68 

■  0.41 

Group  . 

195.16 

2 

97.95 

5.08 

0.01* 

2-Way  Interactions 

3.17 

.  2 

1.58 

0.08 

0.92 

FD/FI  Group 

3.17 

2 

1.58. 

0.08 

0.92 

Explained 

206.15 

5 

41.23 

2.15 

0.07 

Residual 

1517.81 

79 

19.21 

Total 

1723.95 

84 

20.52 

*  Significant  .at  the  0,01  level  of  Significande 
**  Significant  at  the  0,05  level. of  Significance 


TABLE  3    ^  . 

Cell  Means  of  Posttest 

Scores  by  Field  Dependence/Field  Inctependence  and  Treatment  Groups  , 

Color  Treatment                 B/W  Treatment  Control 

Field  Dependence 

12.14                                  12.20  9.50 
(7)                        •            (10)                         (6)  . 

Field  Independence 

13.64                                  12.95                         9.90  ' 
(22)                                   (19)  (21) 

Sroup  Mean 

.  13.28                                  12.69  9.81 

(29)     ^     _                         (29)  ,  (27) 

Field  Dependence  =11.48 

(23)             \  . 
Field  Independence  =  12.16 

(62) 

TOTAL  POPULATION  =11.98 

(85) 

2U 
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TABLE  4 


Pearson   Correlation   Coefficients   of   Field   Dependence/Field  "  Independence 
and  Achievement    (Posttest   Scores)  .  - 


'  ' — ^  '.  ■ 

GROUP  SCORE 


Color  Treatment  0  35 

FD/FI  p=0:03° 


Black  and  White  Treatment  .  •  n  21 

-  FD/FI  '  p=0:i3 


Control  0  07^ 

FD/FI  '  \   -  p=0.'37 
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TABLE  5'  - 

lysis  of  Variance  o'f  2-way  interactions  of  Posttest  Time  with  Field  Dependence/ Field,  Independence 

'  and  treatment  groups  '  - 


Source  of 
Variation 

Sums  of 
Squares.. 

OF 

t 

Mean 
Square 

F 

<> 

Significance  of  F 

MAIN  EFFECTS  / 

20358.01 

3 

6786.00 

2.00 

U  •UD 

0 

rur  1 

'  2080.08 

1  ' 

2080.08    ^  ' 

0.81 

0.37 

GRODP 

18591.94 

•  2 

9295.97 

3.60 

0.03* 

2-WAY  INTERACTIONS 

8943.48 

2 

•4471.74 

1.73 

0'.18  " 

FD/FI  GROUP 

8943.48 

• 

44h.74 

-  1.73 

0.18  . 

EXPLAINED 

...    '■  ^  29301.50 

5 

5860.30 

2.27' 

0.06         •  . 

RESIDUAL 

203784.69  • 

79 

2579.55  , 

TOTAL 

233086.19 

84 

2774.84 

t 

f 

^  1 

♦Significant  at  the  .05  level 
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Introduction- 


background 


"Permission  to  reproduce  tViis 
.material  has  been  granted  by 

'  Michael  Simonson — r- 


f  O  THE  EDUCATIONAt  RESOURCES 
iiJM^dRMATiON  CeT^TER  (ERIC)." 


It  has  been  noted  by  ..Jiiany  c  eliucati^nkl  researchers/  in  {recent  y earfe  ithat  our 
traditional  research  methodologiW,  especially  cohveritibnal  experimental'  designs^, 
seem^to  be  unable  to  provide  meaningful  ap^pl:^cation  .to-"thp  pr^cticeo^ 
Experimental  designs  seem  to  bV  lacking  in  theS.r  "abiaity  ^  to  ideritifV  .the  "process 
variables  that  could  improve  teachlngV,.' (Scriven  ,^  their  aiJpli cation 

appears  not  to  faailitate  solutions,  t'o  educatio^^^  ( Clark', p 978.; 


a  restrictiveness  that-  seemfe' to*  be't  the  result;  of  rtightly-controlfed  experimental^ 
variables.     Such  tigh't  control :ap'p^ar3V'to  markedly  re^  reliability 
of  findings  (Barr,.1929;  Calkins,  et^.^aT.  /  :'l978 ;  Sha^^^         &;Pemps^,  1-975.) 
and  to  significantly  lijTiit  general i'zability  o-f,resui^^  1?75;  / 

Ebel,   19^7;  Gage,   1952;  Pereboom,;  1971 ) .    "     .'^     V  ?  ^  ^- "  ' 


problem 


In  reaption,  there  have  been, calls  for  alternatives  to  the  structure ^of 
research  design  (Shulman,  '{970)  and  the  "modes-'of  inquiry  within  our  research 
endeavors"  (ICoetting,   1963,  p. ^30).    More  specifically,  researchers  have  a^ked 
for' research  models  that  reflfect^and  are  appropriate  to  the  pr^ctic^  of -education 
,(Becker,  1977;  Clark,.  1979;  Shulman,/  1970) ;  and  for  research  paradigms  and  .  ^  * 
methodologies  tha€  address  the^whole  learner  as  a  total  system  (Beckwith,  19^0; 
Clark,   1980;  Winn-,  'l975),  nonreductioni'fet  approaches  to  research  which  attend- 
to  the  elaborate  nature- of  learners  as  dynamic/ changing  individuals  (Merrill, 
1975;  Torkelson,  1980)     research  that  focuses  on  the  aims"  and  values  of 
education,  (Rosenow,  1976).  \-  ;        .  -  '  '  . 

theoretical /conceptual' base  ^  •  . 

Such  requests  demand^a  complex ,  sophisticated  research  paradigm  founded 
firmly  upon  a-^theoretical /conceptual  base,  a  base  that  incorporates 
alternative  modes  of  vali'd  rationality  (Koetting,   1983).^    Beck^with:  (1983) 
has  provided  such  a^bas.e.     Following  foCir  years  of  constructioni3t  researcfi ,  • 
he  has  developed  a  theoretical /conceptual  paradigm  of  the  learner  ^s  a  total, 
system.    Withiri  the  paradigm  four  types  of  total" learneP^ systems  have  been 
^identified  and  explicated  according  to  the  following  categories  of  critical 
attributes:  -  . 


(a)  motivation;  >        ,  •  * 

(b)  response  to  external  variables;  *  .  .     ^.  . 

(c)  response  to  intervention;  '     .  ' 

(d)  predominant  strategies; 

(e)  'transition  possibilities,  facilitators,  inhibitors,  and  control ;  * 

(f)  reason  for  goal 

■  >    .  ..■  .  .  -       •      26  .  . 


(g)  relation  to  jgoal ; 

(h)  ■  type  of. interaction  and  interrelation  of  system  components;  and 

(i)  ^     typer.of  dynamism. 

In  short,  Beckwith's  paradigm  focuseis  upon' the  aims  and  values  of  education 
while  attending  to  the  learner  as  an  elaborate  dynamic,  everchanging  total 
system.     A  summary  of  the  paradigm's  four  learner  systems  follows  (exerpted 
from  Beckwith,  1983)-  r-. 

Ihe  learner  may  be  seen  as  four  distinct  systems,  reactive ,  preactive , 
proactive,  and  spiralling,  each^of  the  four  systems  meeting  the  definitional 
system  requirements  of  being  dynamic,,  having      goal,  and  having  interdependent 
and  interrela,ted  components.    ,The  differences  lie  in  the  nature  of  each' system 's 
goaland  the  relation  of  the  goal  to  the  dynamism  of  the  system  components. 
For  the  reactive  learner  the  goal  is  internally  oriented,  survival  focused; 
thus  the  dynamism  is  incidental,  reacting  intuitively  to  external  variables. 
For  the  preactive  learner  the  goal  is  output  oriented,  focused  towards 
undefined  betterment ;. the  dynamism,  being  externally  programmed,  is 
related  to  the  goal  attainment  process  rather  than  a  specified  goal  product. 
For  the  proactive  learner  the  goal  is  outcome  oriented,  focused  on  solving 
self-'predefined  problems;  the  dynamism  is  thus  purposeful,  related  to  goal 
attainment.     For  the  spiralling  learner  the  gogl  is  value  structure  oriented, 
focused  on  self-regeneration;  the  dynamism  is  intrinsically  automatic, 
related  to  a  continued  process  of  spiralling,  regenerative  goal  setting  and 
attainment.   (See  Figures  1  and  2). 

PLACE  FIGURES  1  AND  2  ABOUT  HERE  '  \ 


Just  as  the  goals  and  dynamism  of  each  learner  system  are  different,  so  too 
is  the  predictability  of  exhibited  behaviors.     The  reactive  learner's  behavior 
is  unpredictable;  reacting  to  external  variables,  the  behavior  will  either  be 
acceptance,  denial ,  or  denial  and  then  acceptance  (conscious  or  unconscious). 
The  preactive  learner,  out  to  satisfy  the  social  order,  may  exhibit  highly 
predictable  behaviors.     The  proactive  learner's  behavior  is  predictable  within 
the  framework  of  self-established  goals,  i.e.  problems  to  be  .solved. ^  The 
behavior  of  the  spiralling  learner;  like  that  of  the  reactive  learner,  is 
unpredictable,  for  the  learning  process  is  very  akin  to  intuition,  only  the 
spiralling  learner's  intuition  is  purposeful,  /being  effective  in  spite  of  the 
learning  environment. 

O  '  ■     ■  ■ 

the  reactive  learner  system 

Reactive  learners  are  survivors,  reacting  -  unconsciously  and  intuitively 
-  to  external  variables  and  intervention  of  contradictory  information  by 
absorbing  or  rejecting  them  as  quickly  as  possible.     The  only  goal  is  maintenance 
of.  an  unthreatened  ecological  system.    The  reactive  learner  system  absorbs  „ 
and  stores*  information  to  be  retrieved  as  stored. 
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the  preactive  learner  system 

While  many  of  the  equilibrium  maintenance ' behaviours  of  the  reactive  learner 
(operating  as  a  natural  system)  are ^present  in  the  preactive  learner  (operating 
as  a  synergystic  system),  the- preactive  learner's  behaviors  are  far  more 
conscious  and  socially  acceptable;  the  "rules**    for  equilibrium  maintenance 
have  become  institutionalized,  i.e.,  the  individual  has  adopted  the  society's 
mores  for  learning  survival. 

The  preactive  learner  system  receives  appropriate  information  in  appropriate 
formats,  as  so  deemed  by  the  educational  system.     As  skills  increase,  the 
preactive  moves  closer  and  closer  (like  externally -bound  concentric  circles) 
in-  harmony  with  the  .undefined  goals  of  the  educational  system. 


the  proactive  learner  system 

The  proactive  learner  operates  well  fi^om  a  traditional  base,  providing  self- 
motivation,  extracting  essential  bits  from  information  presented,  welding  bits 
from  storage  and  alternative  sources,  building  himself  a  personalized  System 
to  facilitate  personalized  goals.    External  intervention  is  avoided,  self- 
control  and  reinforcement  being,  preferred .     The  proactive  learner  system 
uses  information  gleaned  from  the  educational  system  to  attain  goals  that 
are  not  those  of  the  educational  system. 


the  spiraling  learner  system 

It  may  be  said  that  so  sophisticated  is  the  spiralling  learner  system  that 
learning  tends  to 'occur  in'spite  of  the  learning  environment,  for  this 
learner  is  able  to  extract  out  of  context  and  rapidly  assimilate  into  the 
spiral  at  a  very  high  level  of  discrimination  and  purpose.     The  spiralling 
learner  system  productively  applies  information  for  continued  self-regeneration 


transition  •  '  y 

Transition  is  possible  from  some  learner  systems  to  others.     Transition  from 
reactive  to  preactive  is  generally  possible  through  prolonged  subjection  to  a 
social  structure ,  spurred  on  by  peer,  institutional,  and  social  pressures. 
Transition  from  reactive  to  proactive  is  generally  possible  through  counter 
reaction  to  current /predominant  social^order ,  .spurred  by  a  need  for 
independence  and  social  conscience  ."^    Transition  from  reactivfe  to  spiralling 
is  generally  possible  thorugh  intuition,  spurrecj.  by  altruistic  feelings  and 
concerns.    Transition  from  T^reactive  to  proactive'^is  generally  possible  through 
gut-wrenching  upheaval ,  spurred  by  dissatisfaction  with  the  established  order. 
Transition  from  proactive  to  spiralling  is  generally  possible  through  practice, 
spurred  by  internal  motivation.   (See  Figures  3  and  ^). 

t  ■ 

PLACE  FIGURES  3  AND  H  ABOUT  HERE 

'  ■  " 

It  is  hoped  that  the  paradigm,  after  significant  further  testing,  may. serve 

as  a  theoretical  base  for  innovative ,  learner-centred  instructional  development 

and  research  methodologies. 

implications  for  research     .  ' 

As  mentioned  earlier,  with  our  reductionist  appjmch  to  research  (experimental 
design)  we  have  ignored  the  elaborate  nature  of  learners  as  dynamic,  changing 


individuals  (Torkelson,  1980).     Is  it  possible  that  our  research  paradigms/ 
methodologies  reflect  and  explore  only  the  preactive  learner?      Are  the  mean 
performances  all  exhibited  by  the  preactive  learner?    For  the  most  part, 
res"earchi  in  education  seems  to  view,  the  learner  as  being  part  of  an 
educational  system,  whether  such  system  be  a  classroom,  subject,  course 
of  study /curriculum ,  or  school.     We  look  at  the  learner's  progress  in  terms 
of  the  goals  of  this  educational  system,  attempting  toidentify  variables 
which  may  enhance  or  inhibit  learner  progress  in  reaching  such  goals. 
This  could  indeed  be  labelled  as  a  preactive  learner  research  tradition. 
Whether  we  look  at  research  in  aptitude-treatment  interaction,  cognitive 
styles,  or  learner  attitudes,  toname  a  few  of  the  most  recent  research 
thrusts,  the  emphasis  is  the  same,  that-  of  examining  the  learner  as  part 
of  a  system,  i.e.,  a  given  educational  system,  a  system  dedicated  to  the, 
preactive  learner,  who  in  turn  is  dedicated  to  the  system.     Such  research, 
it  seems,  evpn  assumes  that  all  subjects  are  preactive  learners,  differing 
only  in  their 'preactive  learning  ability.-    All  learners,  however,  are  not 
preactive;  tKe  nonpreactive  learner's  reactions  to  external  variables 
are,  from  a  preactive  standpoint,  unpredicatable  and  ungeneralizable . 
The  reactive  learner  will  absorb 'or  deny  external  variables  in  a  quest  for 
survival.      The  proactive  learner  will  use  or  ignore  external  variables 
depending  upon  their  potential  usefulness  in  self-goal  attainment.  The 
spiralling  learner  will  use  all  external  variables  productively  for 
^'continued  self-regeneration.     The  non-preactive  learner  is  not  operating 
within  the  goal  structure  of  the  societal  system,  but  rather  is  operating 
in  spite        this  goal  structure,  yet  through  our  preactive  research  designs 
and  questions  we  are  expecting,  without  realising  it,  the  nonpreactive 
learner  to  behave  preactively. 

Perhaps  it  is  time  to  view  the  educational  environment  as  part  of  the 
learner*s  system..   Our  research  then  could, look  at  the  educational 
environment's  progress  in  terms  of  enhancing  or  .inhibiting  the  learners' 
attainment  of  their  own  goals.     What  are  the  variables  within  the  educational 
environment  which  inhibit  or  enhance  such  goal  attainment?    How  do  learners' 
incorporate  external  variables  into  their  own  learner  systems?    This  will 
not  be  an  easy  shift  to  make,  for  our  whole  socio-scientific  research 
tradition  is  based  upon  the  preactive  learner  model ;  we  strive  to  learn, 
to.  discover,  with  no  predefined  goal  in  mind,  but  rather  merely  the  goal 
of  more  complete  understanding  of  what  is  (with  the  underlying  belief 
that  such  more  complete  understanding  will  somehow  improve  us).     By  exploring, 
discovering  and  applying  (if  possible),  our  preactive  research  mode  keeps 
alive  the  synergystic  dream  that  the  total  of  our  discoveries  will  be  greater 
than  the  sum  of  its  parts.  •  As  long  as  our  research  efforts  are  confined- to 
the  framework  of  our  own  system  goals,  the  answers  to  such  questions  as  how 
the  learner,  especially,  the  nonpreactive  learner,  represents  an  experience 
or  perceives  during  the  learning  process  will  remain  mystery. 

In  any  case,  more  research,  of  course,  is  needed  -  research  that  explores, 
in  nontraditional  ways,  the  nonpreactive  as  well  as  the  preactive  learner 
system;  research  that  looks  at  the  transitions  within  and  between  learner 
systems;  research,  in  short,  that  attempts  to  validate  the  assumptions 
inherent  within  the  conceptual /theoretical  paradigm  presented  here. 


alternative  research  methodology  ^ 

This  paper -will  present  an  alternative  research  methodology  based  upon 
Beckwith's  theoretical /conceptual  paradigm ,  elucidating  on  the  methodology's 

(a)  underlying  assumptions, 

(b)  focus,  2A 

(c)  nature,  and  ^  -  .  QQ 

(d)  -  management. 


This  will  be  followed  by  a  discussion  of  the  roles  of  investigator',  subject, 
manager  and  design  structure  during  operation  of  the  research  methdology . 


assumptions 

Since  the  methodology  is  based  upon  a  total  system  learner  paradigm,  it  is 

"assumed  that  each  and  every  learner  may  be  viewed  as  a  (system)  in  and 

of  itself^  not  only  as  a  (system)  that  is  but  also  as  a  (system)  that  could 

be.      Even  though  the           learner           will  hold  together  as  an  entity  in 

*spite  of  what  educators  may  or  may  not  do,  its  finer  potential  lies  in 
its  capability  for  becoming  what  is  wishes  to  become.     In  any   — learner 
the  ingredients  are  all  there,  even  if  some  of  those  ingredients  are 
knowing  that  some  of  the  essential  ingredients  are  not  yet  there;  the 
potential  of  all  ingredients  is  there."     (Beckwith,  1980,  p. 332).   "Each  • 
learner,  ther fore ,  may  be  studied  not  only  as  an  existing,  dynamic  system 
but  also  as  a  potential,  dynamic  system.      By  studying  the  nafure  of  the 
learner's  critical  attributes  (the  categories  of  which  are  mentioned  earlier) 
determinations  can  be  made  concerning  the  learner's  exisitng  system,  former 
system(s),  potential  system(s),  and  paths  of  transition.     With  such  data  on 
each  learner  system, it  is  assumed,  researchers/educators  may  tailor  the 
educational  environment  to  facilitate  desired  learner  outcomes,,  i.e. 
learner  -goals.      To  accomplish  this,  the  learner  must  be  accepted  as  full 
partner  in  the  research  development  effort.     If  formally  stated,  the  learner 
as  total  system  paradigm  rests  on  the  assumptions  that: 

(a)  fhere  are  two  realities     (the  existing  reality  upon  which  inquiry  can 
converge,  and  the  potential  reality  which  inquiry  can  effect)  and 
that  all  parts  of  reality   (existing  and  potential)  are  interrelated 
and  interdependent  so  that  the  study  of  or  inquiry  into  any  one  part 
necessarily  influences  all  other  parts; 

(b)  the  inquirer  and  ob ject>  for  best  results,  are  one,  with  the 
investigator  -  playing  the  role  of  facilitative  co-researcher.  Thus 
the  relationship  between  the  inquirer  and  the  object  of  inquiry  is 
neither  one  of  independence  nor ^dependence ,  but  rather  one  of  mutual 
introspection  and  creation; 

(c)  each  learner  is  currently  operating  as  a  total  system,  and  can  create 
a  potential  total  system;  and 

(d)  generalizations-,  to*  other  populations,  concerning  the  nature  of  goals, 
dynamism  and  transitions  of  learner  systems,  is  possible. 


focus  !  .  , 

Whereas  traditional  experimental  design  methodologies  look  at  data  in  a  frozen, 
controlled  fashion  -  Isolating  and  then  correlating  variables  in  an  attempt  to 
find  out  "what  is"  -  this  alternative  methodology  looks  at  data  as  part  of  a 
growth  phenomenon,  dynamic,  constantly  changing;  looks  at  the  processes  of 
transition,  system  creation,  regression  in  an  attempt  to  find  out  "what  is 
becoming"  and  "how".      The  focus,  rather  than  being  pn    tightly -controlled 
variables,  is  on  the  dynamism  of  the  total  system,  on  the  everchanging 
interrelationships  and  interdependencies  of  the  system  components.  The 
focus,  rather  than  being  within  the  framework  of  the  goals  of  the  educational 
system,  is  within  the  framework  of  the  goals  of  the  learner  system. 
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nature  ^  • 

The  methodology  in  action  might  be  described  as  a  dynamic  collection- 
analysis-decision  system  of  interrelational  events,  a  sifting-sorting- 
cataloging  of  observed,  felt,  and  thought  behaviours  in  order  to  more 
purposefully  analyze  the  next  behaviour (s) ,  using,  at  times,  the 
interjection  of  appropriate  feedback,  comment,  reinforcement. ,  questions , 
'disruptions  to  elicit  whatever  behaviors  will  emerge.     As  on-going/chan^ing 
research  in  an  on-going/changing  context,  this  methodology 

(a)  maintains  the  dynamism  of  system  by  embracing  all  variables; 

(b)  collapses  the  element  of  time  between  the  typically  separate 
p         activities,  of  research  and  application; 

(c)  protects  the  inherent  uniqueness,  individuality  and  personality  of 
the  studied  systems. '(focusing  upon  the  extremes  as  well  as  the 
centrral  tendenfcies); 

(d)  protects  the  integrity  of  the  system  interactions;^  and 

(e)  performs  during  real  time,  within  dynamic  systems,  while  attending 
\o  validity  and  reliability  . 

\feriables  are  not  isolated,  but  rather  interr'e;ationships  and  interdependencies 
of  variables  are  explored  and  welcjpmed  as  they  are;  there  are  no  variables 
that  are  capable  of  confounding,  for  it  is  accepted  that  all  variables 
naturally  affect  all  other  variables  and  may  only  be  contnolied  by  being 
allowed  their  full  natural  freedom  of  expression- 

In  the  sense  that  the  methodology  is  so  precisely  defined,  applicable  to 
each  and  every  dynamic  learner  system,  generalizability  is  complete. 
Each  learner  syjstem  is  a  special  case,  with  the  focus  being  in-depth- 
truth-seeking ,  finding  that  which  is  generalizable  from  him  to  him  (or 
her  to  her)  within  a  given  point  in  time  and/or  from  him  or  her  "now" 
to  him  or  her  "future".    Thus  the  methodology  provides  generalizability 
within  each  learner  system  studied  and  also  to  any  and  all  populations, 
i.e.,  it  is  capable  of  achieving  the  same  level,  of  significance  with  each 
learner  system. 

management  *  «  >     ^  . 

While  the  complexity  and  number- of  interrelating  and  interdependent  variables 
may  appear  forbidding ,  management  of  this  researchmethodology  ,  while 
certainly  unusual,  is  not  that  difficult.    Given      ^  . 

(a)  the  framework  of  expectations  provided  by  Beckwith 's 'paradigm , . 

(b)  acceptance  of  the  learner  system's  own  goal  as  the  context  of  the 
research  study  ,  

-(c)  acceptance  of  the  learner  system  itself  as  a  co-researcher  in  the 

process ,  and 

(d)  the  view  that  the  researcher  and  the  educational  environment  are 

components  of  the  learner's  system,  the  seemingly  formidable  task 
becomes  one  of  relative  ease. 

For  the  researcher  as  part  of  a  defined,  dynamic,  goal-directed  system  with 
his  or  her  purposes  known  and  welcomed  by  the  system  itself,  becomes 
comfortable  with  and  adept  at  studying  the  dynamic  interrelations  and 
interdependencies  of  which  he  is  part.    As  the  comfort  and  aptitude  increase, 
the  researcher  is  quite  quickly  able  to  stu^  moj^and  more  learner  systems 


simultanecusly  ,  applying  ever  more  increasingly  and  successfully  what  he 
has  learned  as  part  of  each  studied  system  to  each  newly -encountered  system. 

operation  of  the  research  methodology 

It  is  the  purpose/intent  of  this  section  to  give  a  more  specific  account  of 
how  the  methodology  would  be  operationalized  while  at  the  same  time 
suggesting  how  such  as  validity,  reliability,  reproducibility,  bias  and 
effects  are  attended  to  during  the  process.     The  actual  techniques  of  the 
methodology  are  not  delineated,  but  rather  are  alluded  to. 

For  this  r.ethodology  ,  the  trained  educational  researcher  is  called  the 
investigator-researcher,  the  learner  system  under  study  is  called  the 
subject-researcher-,  and  the  data  interface  coordinator  (whether  .this 
function  is  provided  by  either  or  both  of  the  co-researchers,  a  computer, 
or  a  specialist)  is  called  the  information  manager.    These  three  roles- 
investigator-researcher  ,  .sub  ject-researcher  and  information  manager-create 
the  interactive  dynamism  of  the "design  structure.     (See  Figure  5)- 

Through  the  interaction  of  the  three  components^ the  design  structure 
facilitates  fulfillment  of  the  purpose  of  the  research  design  -  to  (a) 
determine  the  nature  of  the  current  learner  system  . (b)  determine  the  nature, 
of  the  current  learner  ability  level,     (c)  determine  the  nature  of  the 
desired  (ty  the  learner)  learner  system,  and/or  ability  level  and  (d) 
determine  the  most  appropriate  transition  means.     In  order  to  do  this  the 
situation  within  which  the  design  structure  operates  must  be  one  in  which 
the  subject-researcher  may  be  observed,  by  self  and  the  investigator- 
researcher,  during  the  learning  process.     There  must  be  access  to  a  large^ 
variety  of  instructional  information  in  a  large  variety  of  formats. 
As  Merrill   (1975)  has  suggested: 

e. 

...  what  is  needed  is  a  dynamic  general  strategy 
enabling  learners  to  select  at  any  moment  the 
particular  tactic  that  'is  optimal  for  their  unique 
configurations  of  aptitudes  at  that  moment  in  time-. 
Furthermore,  they  must  be  able  to  select  a  new 
tactic  at  a  moment's  notice.    They  must  not  be  . 
required  ^o  anticipate  their  aptitude  configuration 
or  the  tactic  needed  more  than  one  step  ahead.  They 
must  be  able  to  make  the  change  with  a  minimum  of  . 
effort.     (If  all  their  time  or  even  a  significant 
part  is  used  up  in  the  mechanics  of  tactic  selection, 
their. learning  continuity  will  be  grossly  impaired.) 
They  must  know  how  to  select  a  variety  of  tactics. 
They  must  have  a  wide  variety  of  tactics  available 
to  them  but  not  so  many  that  they  are  overwhelmed 

by  the  number  of  choices  .  ---They --must..-be,„pr.ovided  a__    ;  _ 

procedure  for  adapting  slowly^  td  this  dynamic 
instructional  environment  since  all  their  previous 
experience  has  been  fixed  treatments  which  have  been 
administered  to  them  and  over  which  they  have  had 
.  little  or  no  control.-,  •  ' 

The  learner,  going  through  such  instructional  information  (if  the  for-nats 
are  varied  sufficiently  enough  to  represent  the  continuum  from  passive 
reception  through  interaction  to  creation)  will,  it  is' hoped ,  demonstrate 
his  current  learner  system  and  ability  level.    To  facilitate  the  process, 
the  investigator-researcher,  reacting  to  subject-researcher  requests  a>Jd 
information  manager  suggestions  (based  upon  an  analysis  of  the  effectiveness .J 
^5  .f^«n=i  inrormation  Fcontent  and  formgA3.for  eliciting  attributes), 


supplies  each  next  piece  of  instructional  information.    The 'information 
manager  supplies  the  subject-researcher  with  learner  system  profiles, 
based  upon  an  analysis  of  (a)  the  learner's  process  of  inquiry  while 
going  through  the  instructional  information,  and  (b)  the  classification 
of  demonstrated  and  communicated  attributes  (fed  in  by  the  investigator- 
researcher).    The  subject-researcher  and  investigator-researcher  work 
together  to  analyze  the  incoming  learner  system  profiles,  which  analyses 
are  fed  back  to  the  information  manager.    Once  the  learnings  process  has 
begun,  the  above  procedures  are  simultaneous  and  interdependent  (See 
Figure  5) .  '  . 


role  of  the  design  structure 

There  are  three  purposes  of  the  design  structure:   (a)'to  facilitate 
solutions  to  educational  problems,   (b)  to  attend  to  the  elaborate  nature 
of  learners  as-'^dy  namic ,  changing  individuals,  and   (c)  to  effect  research 
'reliability  and  validity.  ,  These  are  accomplished  by  initiating  a  dynamic 
set  of  interactions  and  interdependancies  between  the  three  major  elements 
of  the  research-'-  the  subject-researcher,  the  investigator-researcher^ 
and  the  information  manager.      How  the  structure  enhances  the  satisfaction 
of  these  purposes  is  discussed  below: 


facilitating  solutions  to  educational  problems 

In  order  to  facilitate  solutions  to  educational  problems,  Lt  is  felt  that 
a  research  design  structure- should  (a )  focus  on  the  aims  and  values  of 
education.     (The  questions  that  can  be  attended  to  through  this,  design 
structure  are  those  derived  from  a  theoretical  base,  thus  increasing 
leverage  and  reducing  uncertainty);     (b)  reflect  and  be  appropriate 
to  the  practice  of  education.     (Since  the  users  of  the  research  results 
provided  via  this  design  structure  are  learners,  and  problems  researched 
focus  upon  the  inefficiency  and  ineffectiveness  of  learning,  it  may  be 
assumed  that  the' problems  are  operationally  important  to  the  user) ; 
and  (c)  identify  the  process  variables  that ^^^coy^,d*tt*mprove  teaching  (Since 
the  co-researchers  are  able  to  apply  results  as  received,  action  decisions 
can  be  based  on  inferences  drawn  from  the  research  data . ) 


attend'ing  to  dynamic  learners 

By  attending  to  the  elaborate  nature  of  learners  as  dynamic,  changing 
individuals,  this  design  structure  tends  to  minimize  (a)  bounding 
problems  by  allowing  the.  co-researchers  to  continuously  narrow  their  . 
scope  of  investigation-through  the  process  of  causal '  inferencing  -  as 
they  get  closer  and  closer  to  learner  system  and  ability  determination; 
and  (b)  focus'ing  problems  by  organizing  and  ascribing  meaning  to 
collected  data  within  the  parameters  of  the  learner  as  a  total  system 

 -paradigm-. -~Xn-addxt±Qa  c^t>inued  dynamism  is  effected  by  ensuring  that  

data  collection  and  data  analysis  occur  in'syncopated  harmony,  forming 
^a  sym'bionic  relationship  -  each  guiding,  feeding,  nurturing,  leading,, 
following  the  other .-  acting  as  a  team,  in  consort  toward  the  same  end. 
Thus  the  research  process  is  structured  and  restructured  within  real  time 
by  coirapsirig  the  time  between  research  findings  and  applications.  This 
nonreductionist  type  of  control  through  acceptance  of  all  variables  is 
the  key  to  researching  a  dynamic  system. 
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effecting  validity  and  reliability 

By  not  using  tightly-controlled  experimental  variables  which  tend  to  markedly 
restrict  retest  reliability  of  findings  and  to  signif:.cantly  limit 
generalizability  of  results,  unrealistic  restrictiveness  is  not  a 
limitation  of  this  design  structure.. 

Generalizability  is  maximized  not  by  controlling  individual  variables 
through  isolation  and  treatment,  but  rather  by  controlling  the  complete 
set  of  variables  within  the  structure  of  the  total  system  framework. 
What  is  generalizable  is  the  systemic  nature  that  is  true  for  each 
learner.  .  It  matters  not  and  affects  generalizability  little  if  the 
components  differ  somewhat  from  system  to  system;  since  all  subjects  are 
systems,  it  is  fairly  easy  to  predict  correctly  the  range  of  possible 
outcomes  elsewhere,  with  other  subjects,  at  other  times.    The  generalizability 
of  results  is, enhanced,  in  part,  by  maximizing  freedom  from  artificially^ 
structured  environments;  as  the  subject-researcher  inquires  into  the 
nature  of  his  current  learner  system,  he  is  allowed  to  begin  virtually 
anywhere  and  to  move  anywhere  in  each  succeeding  step.^ 

Generalizability  also  benefits  from  the  enhancement  of  reproducibility; 
for  example,  sample  size  is  minimized  (one  subject-researcher)  as  is  bias, 
through  the  sharing  of  perceptions,  input  and  output  by  the  co-researchers 
and  the  information  manager;  and  also  random  error,  by  continually  feeding  all 
steps  of  all  processes  to  the  information  manager  which  analyzres  all  potential 
discrepancies  within  the  system  framework. 

By  structuring  a  real  learning  environment  and  by  allowing  the  subject  to  be  a 
conscious  and  integral  part  of  the  research,  generalizability  is  further 
enhanced  by  minimizing  reactivity. 

Retest  reliability  is  enhanced  by  teaming  the  sub jectTand  investigator- 
researcher  with  the  informa^tion  manager  in  order  to  maximize  objectivity 
and  minimize  bias.      The  built-in  two  way  communication  between  all  three 
research  components  of  the  design  structure  tends  to  give  a  reliability 
control  to  the  dynamic  process  of  data  collection,  analy.sis' and 
application.      Since  ail  subjects  are  assumed  to  be  total  learner  systems 
and  a-csample  of  one  recommended  for  each  experiment,  random  sampling  is 
relatively  easy.    The  design  structure  does  not  inhibit  random  sampling 
within  the  context  of  a  disproportionate  stratified  designee. g.,  one  could 
randomly  select  subjects  from  a  population  -of  only  one  type  of  learner 
system. 

Within  the  context  of  a  total  system  all  variables  are  dynamically  related 
to  all  other  variables.    To  study  the  system  is  to  study. the  dynamic 
relationships  of  all  variables,  to  embrace  all  variables.    The  notion  of^  . 
confounding  variables  is  not,  therefore,  relevant  to  the  study  of  learners 
as  total  systems. 


roles  of  the  components  of  the  dynamic  design  structure 

As  mentioned. earlier ,  the  subject-researcher,  the  investigator-researcher 
and  the  information  manager    perform  as  interactive  and  interdependent 
entities  of  this  dynamic  research  system.     Each  has  a  vital  role  to  play, 
and  each  depends  upon  the  other  two  in  order  to  fulfill  its  role.     In  traditional 
research  of  dynamic  systems,  i.e.  ,^  learners,  an  attempt  is  made  to  freeze 
reality,  to  make  a  dynamic  system  static,  in  order  to  study  it.     In  so  doing, 
the  relationships  studied  are  no  longer  true  representations  of  reality;  the 
O  detached  observer  of  a  dynamic  system  relinquishes  control. 
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In  this  alternative  research',  in  order  to  gain  and  maintain  research  control 
of  a  dynamic  system,  the  researcher  attempts  to  enter  the  system,  interact 
with  the  ^stem,  and  become  a  dynamic  component  of  the  system.    The  subject- 
researcher,  of  course,  is  able  to  achieve  this  complete  incorporation  of 
researcher  and  subject.     The  inclusion  of  subject *as  researcher  is  essential 
if  the  research  is  to 'extract  and  study  the  internal  cognitive  processes 
(e.g.  selection,  organization)  that  only  the  learner  may  be  aware  of.  Thus 
the  subject-researcher,  by  applying  meta-cognition ,  is  able  to  share  with  the 
investigator-researcher  and  the  information  manager  the  selective  learning 
processes  and  cognitive  organization  processes  that  are  operating. 


If  the  subject-researcher  (probably  not  as  yet  skilled  in  the  processes  of 
controlled  inquiry)  is  to  perform  the  causal  inferences  required  by  the 
research  paradigm,  tutoring,  modeling,  and  support  will  be  required  by  the 
investigator-researcher.     As  a  competent  inquirer,  the  investigator- 
researcher  will  coordinate  and  oversee  data  collection  and  analysis 
procedure,  whether  such  data. and  analyses  are  initiated  by  self,  and  or 
the  subject-researcher,  and /or  the  information  manager.   .This  is 
necessary  because  the  investigator-researcher  is  the  one  who  is  able  to  look 
beyond  the  experimental  data  and  suggest  decisions  based  also  on  learning 
theories  (Allen,  1975).  Unlike  traditional  research 

endeavours,  this  type  of  research  may  indeed  benef;it  from  the  presence 
of  certain  effects.      For  example^  the  investigator-researcher  may  decide 
to  encourage  the  Hawthorne  effect  in  the  subject-researcher,  in  order  to 
stimulate  increased  interest  in  and  ownership  of  the  research  task  at  hand;, 
similarly  the  John  Henry  effect  could  be  encouraged  to  get  the  subject  to 
try  harder.    The  investigator-researcher  might  even  allow  himself  to  be 
biased  .by  the  Halo  effect,  i.e.,  seeing  the  subject-researcher  as  capable 
of  performing  the  research,  each  positive  step  leciding  to  each  succeeding 
positive. step,  thus  reinforcing  the  halo  image. 

Primarily,  the  investigator-researcher's  role  is  that  of  facilitator, 
providing  the  requested  and /or  recommended  instructional  information 
(reflecting  appropriate  content  and. format);  ensuring  reliability  and 
validity  (as  mentioned  earlier ) ;  and  working  closely  with  the  subject- 
researcher  through  the  processes  of  data  collection,  causal  inferencing, 
predictions,  and  applications  based  upon  data  and  theory.     Realizing  that 
"social /behavioural  phenomena  exist  chiefly  in  the  minds  of  people,  and 
(that)  there  are  as  many  realities  as  persons"  (Cuba,  198l  ,  p. 77)  the 
investigator-researcher  must  remove  himself  sufficiently  to  allow  the 
subject-researcher  to  determine  .and  understand  the  current  learner  system 
and,  at  the  same  time,  involve  himself  sufficiently  to  ensure  that  such 
learner  system  determination  and  understanding  is  based  upon  appropriate, 
necessary  and  sufficient  data. 

As  the  subject-researcher  takes  more  responsibility  for  the  research, 
the  investigator^reseacher  becomes  a  less  significant  component  of  the 
learner  system,  thus  allowing  the'  investigator-researcher  to  introduce 
himself  as  a  significant,  component  within,  other  learner  systems.  If 
at  the  same  time,  during  this  growth  of  learner  systems  as  independent 
researchers,.      the  investigator-researcher  structures  the  environment 
so  that  studied  learner  systems  can  share  and  compare  data,  inferences  and 
findings,  the  research  process  becomes  even  more: independent  of  the 
investigator-researcher.    At  very  least  the  investigator-researcher  is 
assuming  a  role  quite  different  from  the  usual  -  a  role  of  facilitator, 
component  of  many  learner  systems,  manager  of  other-defined  research  agendas 
^  rather  than  of  self-  or  pre-defined  research  agendas. 
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For  the  investigator-researcher  to  facilitate  the  inquiry  process  for  the 
subject  researcher,  information  concerning  the  on-going  learning  process 
must  be  made  available  in  usable  form.    The  information  manager  will 
provide  data  on  the  learning  processes  employed  by  the  learner,  the 
effectiveness  of  instructional  information,  as  well  as  a  series  of  increasingly 
sophisticated  learner  system  profiles  (to  include  the  attribute  categories 
of  motivation;  response  to  intervention;  response  to  external  variables; 
predominant  strategies;  successful  learning  env^ironments ;  transition 
possibilities,  facilitators,  inhibitors , c and  control;  and  ability  level 
indicators).    To  produce  the  profiles,  the  information  manager  will 
analyse  incoming  data  along  the  following  interaction  dimensions: 
(a)  contextual  (What  meaning  does  the  learner  appear  to  attach  to 
phenomena?);     (b)  sequential  (What  is  the  order  of  the  steps  being 
followed  by  the  learner?);     (c)  categorical  (What  categories  -  in 
requests  for  instructional  information,  in  causal  inferencing,  in 
interaction  with  the  instructional  information  and  the  investigator- 
researcher  -  is  the  learning  using?) ;     (d)  integral  (How  is  the  total 
learner  system  operating,  i.e.,  what  are  the  apparent  interactive  and 
interdependent  relationships  between  system  components?);    and  (eO 
analytical  (What  methods  of  analysis  is  the  learner  using?). 

If  a  micro-computer  is  being  used  to  provide  an  interactive  learning 
environment  as  one  of  the  ...learner  options  ,  it  may  be  possible- to  program  the 
computer. to  function  as  the  information  manager.     An  added  advantage  is  that 
during  all  interactive  learning  via  the  computer,  the  computer  could  keep 
a  record  of  the  processes  followed  by  the  learner . 


conclusion 

Recently  there  have  been  calls-  for  (a)  .more  global  and  less  laboratory  type 
research;  research  which  allbws  subjec1:|  investigation  rather  than  excluding  , 
the  subject  through  placement  in  an  artificially -created  system  (Bruner,  1983); 
(b)  more 'formative  types  of  research  (parkhurst;  1982);"  (c)  "a  moce  positive  . 
and  accurate  concept  of  human  potential"  (Bloom,  1982,  p. 12);     (d)  research 
means  for  coping  with  the  prolifera\ioh   of  relevant  kinds  of  individual 
differences  to  be  studied  (Gagne  &  Dick,  1983);     (e)  encompassing  "value 
systems  and  idiosyncracies  of  individuals  in  the  large  purpose  of  schooling 
and  society"  (Torkelson-,  1977,  p.        ).;|    (f)  solving,  the  problem  of  "how  to 
serve  the.  needs  of  theory  , and'  action  simultaneously"  (By nner ,  1980,  p.1^);  . 

(g)  selecting  a  "paradigm  (of  disciplined  incjuiry  )  whose  assumptions  are 
best  met  by  the  phenomenon  being  investigated^  (Cuba,  1981,  p. 77);  and 

(h)  providing  the  individual  with  the  opportunity  of  "self-growth  and  self- 
direction  so  that  (he)  can  make  his  own  bargain  wi.th  life  in  accordance 
with  his  beliefs  and  values"  (Gray-son,  j  1976  ,  p.  1310.  . 

1  ■  '      \  -  • 

It  is  hoped  that  the  learner  as  a  total  system  research  paradigm  will  offer 
a  pathway  toward  answering  these  calls'    Rather  than  throwing  away  traditional 
(older  as  well  as  newer)  parddigms  and  jmethodologies ,  this  paradigm  incorporates 
all.     For  example,  such  ATI  attribute  v^ariables  as  anxiet^  achievement  via 
independence  and  achievement  via^^ conformity   (Snow,  1976)  aVe  incorporated 
within  the  reactive,  spiralling  and  pre'active  learner  sy stemSx^respectively  ; 
quantitative  as  well  as  qualitative  data  are.  sy  stematically  collected', 
analyzed  and  acted  upon.      By  incorporating  aspects  of  rationalistic  and 
naturalistic  inquiry  within  the  framework  of- the  learner/as  a  tot^l  system, 
the  limitations  of  each,  tend  to  be  fninimized.  Z7  \ 
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The  Sys^^mic  Nature  of  Learner  Systems 
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In  order  toclassify  learner  systems  (^11  of  which  have  goals,  interacting/interrelating  components, 
and  dynamism)  it  is  necessary  to  analyze  the  sysftemic  workings  within  each  learner  system, 
i.e.,  (a)  what  is  the  relation  of  goal  to  system?  (b)  what  is  the  orientation  (focus)  of  the  system 
goal?  (c)  what  is  the  purpose  of  the  interactions/interrelations  of  system  components?  and 
(d)  what  type  of  dynamism  do^s  t^^e  system  maintain?  While  such  analysis  is  necessary  in  order 
to  establish  each  learner  system's  t>^sic  structure  and  orientation,  it  is  not  sufficient  for  complete 
classification.  In  addition,  the  suDSVstems  of  motivation,  response  td  external  variables,  response 
to  intervention,  predominant  sti'^tegies,  and  successful  learning  environments  should  be 
analyzed.  (See  the  text  for  each  learner  system  for  a  fuller  explication.) 
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Surtirnary  of  Four  Learner  Systems  \, 


Motivation 

Response  to 

External 

Variables 

Response  to 
Intervention 

Predominant 
Strategies 

Successful 

Learning 

Environment 

Reactive 

survival . 

absorbtion 

rejection 

and/or 

absorbtion 

reception 

mentor 

Preactive 

social 
acceptance 

acceptance 

■■J 

acceptance 

.accommo- 
dation 

teacher- 
directed 

Proactive 

r 

internal 
reinforce- 
ment 

sifting 
and 
Sorting 

challenging 

resisting 

denying 

intro- 
spection 1 

traditional* 

Spiralling 

altruism 

applied 
absorbtion 

systemic 
information 

i 

dissonance' 

1 

any^ 

•The  proactive  learner  system,  learning  in  spite  of  the  learning  environmei^t,  uses  the  traditional 
environment,  i.e..  that  environi^^nt  that  is  fashioned/slgMtural  for  reactive  and  preactive 
learning,  to  react  against,  to  reject,  during  the  process  of  creating  his  own  iystems. 
fAnv  environment,  whether  structured  for  learning  or  not.  if  it  provides  information,  has 
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Learners  As  Systems:  Transitions 
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transition  through  intuition,  spurred  by  altruistic  feelings 


Figure  4 

Paradigm  of  Learner.as  Iota)  System 
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This  paradigm  sl)ows  the  three  ability  levels  of  eaeh  learner  system  (low,  middle,  and  high); 
in  each  learner  system  there  may  be  tranr.Stion  back  and/or  forth  between  these  abilit^i"  levels. 
In  addition,  transition  may  occur  between  certain  learner  systems. 
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Abstract 

In  response  to  a  loud  and  long  call,  from  professionals  in  pur  field,  for  a  research 
model  that 

(a)  is  not  restrictive, 

(b)  does  not  limit  genGralizability, 

(c)  identifies  the  process  variables  that  could  improve  the  practice  of  education, 
fd)   addresses  the* whole  learner  as  a  total  system, 

(e)  addresses  the  elaborate  nature  of  learners  as  dynamic,  changing  individuals,  and 

(f)  focuses  ori  the  aims  and  values  of  education, 

this  paper  presents  an  alternative  research  methodology  based  upon  a  theoretical/ 
conceptual  paradigm  of  the  learner  as  a  total  system  (Beckwith,  1983). 

,  The  methodology  assumes  that  each  learner  may  be  viewed  as  both  and  existing 
system  and  a  potential  system,  and  that  the  learner  must  be.accepted  as  full  partner 
in  the  research  effort.  While  traditional  methodologies  focus  upon  f  rozen,  tightly- 
controlled  variables,  this  methodology  focuses  upon  dynamism  of  interacting  learner 
system  components  during  the  process  of  system  maintenance  and  transition;  the  focus, 
rather  thari  being  within  the  framework  of  the  goals  of  the  educational  system,  is 
within  the  framework  of  the  goals  of  the  learner  system. 

As  on-going/changing  research  in  an  on-going/chariging  context,  the  methpdology 
embraces  all  variables,  collapses  the  time  between  research  and  application,  and  facili- 
tates generalizability  within  and  across  learner  systemsr 

Research  management  is  facilitated  by  the  researcher's  becoming  a  dynamic  component 
of  each  defined,  dynamic  goal-directed  learner  system  being  studied.. 
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,       ■  TO  THE  EDUCATIONAL  RESOURC 

Introduction:  information  center  (erio;* 

During  the  past  several  years ^  substantial  research  has  addressed  the 
interaction  between  the  cognitive  style  of  field  dependence/independence  and  * 
how  individuals  process  pictorial  information.    Research  conducted  by 
Wieckowski  (1980)  and  Lertchalolam  (1981)  focused  on  the  relationship 
between  cognitive  style  and  .the  role  of  color  in  pictorial  recognition 
memory.    The  method  of  signal  detection  theory  has  not  however^  been  applied 
to  such  research. 

The  purpose  of  this  ins.'astigation  was  two-fold:    (1)  to  study  the  inter- 
action between  cognitive  style  ^  specifically  field  dependence/independence 
and  pictorial  recognition  memory  for  pictiores  presented  in  three  different 
color  modes;  realistic  color ^  non-realistic  color  and  monochrone  (black  and 
white);  and  (2)  to  further  confirm  the  efficacy  of  applying  signal  detec- 
tion analysis  to  color  recognition  memory  data  as  a  means  of  obtaining  a  more 
accurate  assessment  of  the  role  of  color  in  visuaJ.  information  processing. 

Related  Literature: 


The  area  of  cognitive  styles  has  beccme  an  area  of  extensive  research 
interest  in  recent  years.    Kogan  (1971)  defined  cognitive  style  as  an  in- 
dividual viariation  in  mode  of  "apprehending/  storing^  transforming  and 
utilizing  infonnation."    This  concept  was  further  defined  by  Ragan  (1978) 
who  suggested  that  cognitive  styles  represent  "psychological  dimensions" 
which  describe  individual  differences  in  the  means  \*iereby  information  is 
received/  processed  and  utilized.    Cognitive  styles  can  be  considered 
stable  psychological  attributes.    Witkin^  Moore/  GoodenQagh  and  Cox  (1977) 
I  described  the  three  characteristics  of  cognitive  styles  as  being:  (a) 

oriented  toward  "form"  rather  than  "content"  related  cognitive  activities; 
V    (b)  stable  over  time/  and  (c)  bi-polar  rather  than  hierarchiqal  as  is 
mental  ability. 

  Field  dependence  is  one  such  cognitive  style  \*iich  has  been  reseairched 

mare  extensively  than  many  others.    This  factor/  identified  by  Witkin/ 
Oltman/  Raskin  and  Karp  (1971)  is  generally  defined  as  the  differential 
ability  of  individuals  to  separate  figure  from  ground  or  overcome  "figural 

w  enibeddedness."    Although  described  and  determined  on  a  highly  perceptual 

^  basiS/  this  attribute  is/related  to  many  other  cognitive/  attitudinal  and 

personality  behaviors.    The  perceptual  ability  for  figured  disa±)edding  is 

^  generally  considered  to  be  representative  of  the  more  global  ability  to 

inpose  structure  upon  perceived  information.    Karp  (19(53)  and  Goodenough 

^  (1976)  have  thoroughly  re\^iewed  the  various  correlates  of  field-dependence. 

i^.....--...  
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 Fierd"dependehce~ha^^^^^  remained  substantially  a  perceptual  ,  ~ 

ability  measure,  assessed  by  the  Rod-^and-Frame  Test  or  the  various  embedded  k 
figures  tests,  i.e.  Group  Bribedded  Figyires  Tfest  (Witkin  et  al,  1971).  ^ 

Substantial  research  has  focused  on  the  role  of  color  in  visualized  ^ 
instruction  (Dwyer,  1972,  1978;  Berry,  1974;  Winn,  1976;  Chute,  1979; 
Lamberski,  1980).    This  research  represents  one  aspect  of  the  larger  theoret- 
ical debate  which  continues  regarding  visual  conplexity.    It  has  long  been 
contended  that  the  mere  addition  of  visual  cues  will  increase  the  ability 
^df  the  viewer  to  store  and  retrieve,  visual  information.    Ihis  orientation,  . 
termed  "realism"  by  Dwyer  (1967),  has  drawn  strong  theoretical  support 
(Dale,  1946;  Morris,  1946;  Carpenter,  1953  and  Gibson,  1954)  and  is  indeed 
the  major  pronise  of  cue  surtmation  theory  (Severin,  1967).    Other  re^ 
searchers  (Broadbent,  1958,  1965;  Travers,  1964)  have,  however,  taken  strong 
opposition  to  this  "realism"  orientation  on  the  grounds  that  the  human  in- 
formation processing  system  is  of  limited  capacity  and  that,  in  times  of 
rapid  information  reception,  irrelevant  cues  may  block  the  processing  of 
other,  relevant  information.    Studies  (Kanner,  1968;  Katzman  and  Nyenhuis, 
1972;  Dwyer,  1972  and  1979)  have  investigated  this  apparent  contradiction 
with  conflicting  results. 

The  inclusion  or  absence  of  color  information  can  be  regarded  as  one 
dimension  of  visual  ccmplexity.    Color  can  function  in  a  dual  role  when  used 
in  visual  displays.    First,  it  can  serve  primarily  a  coding  function, 
providing  additional  information  but  not  providing  any  realistic  description 
of  the  elements  of  the  display.    In  this  case,  the  effectiveness  of  color 
can  be  predicted  by  cue  sumration  theory,  but  not  by  the  re;,alism  hypothesis. 
Second,  color  can  be  cues  to  present  a  more  realistic  version  of  the  visual 
display.    In  this  instance,  in  addition  to  providing  a  greater  nuntoer  of 
overall  cues,  it  provides  the  viewer  with  more  realistic  attributes  or 
"handles"  with  which  to  store  and  retrieve  information.    When  color  is  used 
in  this  cueing  role,  its  value  could  be  predicted  by  the  realism  theories 
as  well  as  by  cue  sunroation  the  >ry. 

Much  past  research  investigating  the  differences  between  color  and 
black  and  white  visuals  f ailer^  t  >  take  into  account  the  fact  that  realistic 
color  visuals  con'  iin  intrins  L.a.vly  more  information  and  consequently  re- 
quire  more  time  for  proc^ssj:   .    In  an  attenpt  to  resolve  this  methodological 
inconsistency  as  well  ^.    o  w^re  accurately  assess  the  role  of  color  in  the 
storage  and  retrieval  of  visual  information.  Berry  (1974)  coipared  realistic 
and  non-realistic  color  versions  of  the  instructional  materials  on  the  human 
heart  developed  by  Dwyer  (1976).    Data  suggested  that,  in  those  learning 
tasks  where  visual  iraterials  contributed  significantly  to  the  improvement 
of  instruction,  realistic  color  materials  were  most  effective.  Later 
research  (Berry,  1977,  1982,  1983)  -which  investigated  the  color  realisrV 
coding  question  relative  to  pictorial  recognition  memory  found  both  real- 
istic and  non-realistic  color  materials  superior  to  black  and  wtiite  visuals. 
These  findings  suggested  that  cue  sunination  theory  may  provide  an  accurate 
description  of  how  color  functions  in  basic  infonnatidn  processing  tasks 
such  as  picture  recognition. 

A  number  of  researchers  have  investigated  how  the  aptitude  of  field 
•  dependence/independence  relates  tp  an  individual's  ability  to  percieve  and 
process  both  sinple/ccnplex  and  color/nonochrone  pictorial  information. 
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French  (1983)  found  th^t  field  independent  subjects  experienced  less  difficulty 
processing  unusually  complex  material  than  did  field  dependent  viewers.    Colo^  > 
however,  was  not  considered  a  primary  dimension  of-  visual  complexity.  Research 
conductedby  WieckowskK  1980)  and Lertchalolam  (1981)  suggests  that  individuals 
who  differ  in  "terms  of  field  dependence/independence  utilize  color  information 
differentially  in  recognizing  visuals.    Color  was  shown  to  facilitate  recogni- 
tion of  visuals  by  subjects  who  tended  toward  the  field  independent  end  of  the 
continuum,  while  color  appeared  to  interfere  with  recognition  by  field  dependent 
individuals.    It  is  not  clear  why  such  findings  occurred,  however,  one  possible 
conclusion  iray  be  that  color  information  functioned  as  a  further  embedding  cue,, 
making  it  more  difficult  for  field  dependents  to  separate  distinct  forms  within 
a  visual  v^iich  could  be  used  as  recognition  cues.    It  is  also  riot  clear  why 
color  tended  to  facilitata  recognition  by  field  independent  individuals,  al- 
though one  possible  explanation  may  be  in  the  ability  of  such  individuals  to 
effectively  diseitibed  specific  forms  from  the  visual  ground  and  subsequently 
use  them  as  cueing  devices.    Neither  of  these  hypotheses  have,  however,  been 
adequately  addressed  by  past  research  on  the  color  variable.  r 

Sinple  coiparison  of  recognition  rates  did  not,  however,  take  into 
account  the  subjects'  rate  of  incorrect  responses.    It  has  been  suggested  by^" 
Swets,  Tanner,  and  Birdsall  (1964)  that  in  recognition  experiments,  each 
c±)server  applies  a  particular  criterion  value  to  each  observation.'  Con- 
sequently it  could  be  possible  for  a  subject  to  identify  all  stimuli  as  having 
been  seen  previously,  the  result  of  which  would  be  not  only  a  high  recognition 
rate,  but  also  a. high  error  rate.    Similarly,  if  the  observer  were  to  apply  a 
low  criterion  and  reject  all  items  as  not  previously  seen,  the  resulting  rate 
would  be  low  with  a  correspondingly  low  error  rate.    It  is  apparent  tiiat 
analysis  of  pictorial  recognition  data  should  take  into  account  the  observer 
criterion  and  the  resulting  rate  of  error  which  acccnpany  the  recognition  rate. 
The  msthod  of  signal  detection  theory  has  been  applied  to  the  analysis  of 
recognition  data  in  the  past  as  a  means  whereby  both  recognition  rate  and 
error  rate  are  taken  into  accoimt.  .  " 

Signal  detection  theory  has  been  accepted  as  a  reliable  technique  for 
assessing  a  subject's  ability  to  describe  the  occurrence  of  discrete  binary 
events.    The  basic  model  of  SDT  was  described  in  Swets  (1961)  and  has  been 
nsed  extensively  to  study  the  ability  of  individuals  to  distinguish  the 
pv-esence  of  a  signal  when  that  signal  was  mixed  with  noise.    More  recently, 
Grasha  (1970)  has  suggested  the  use  of  SDT  parameters  in  the  study  of 
Ripnory  processes.    Signal 'detection  theory  has  been  applied  specif  icially  to 
r'^-cognition  maiory  experiments  involving  pictures  in  research .  conducted  by 
f^nodgrass,  Volvovitz  and  Walfish  (1972),  Loftus  and  Kallman  (1979),  Loftus, 
Greene  and  Smith  (1980),  Morrison,  Haith  and  Kagan  (1980)  and  Kagan  (1980) 
and  Berry  (1982,  1983).  .  . 

The  purpose  ^of  this  investigation  was  two-fold:    (1)  to  study  the  inter- 
action between  cognitive  style  differences  and  pictorial  recognition  memory 
for  pictures  presented  in  three  different  color  modes;  realistic  color,  non- 
realistic  color  and  mDnochrcine  (black  and  white);  and,  (2)  to  further  confirm 
the  efficacy  of  applying  signal  detection  analysis  to  color  recognition 
marory  data  as  a  means  of  obtaining  a  .  more  accurate  assessment  of  the  role 
of  color  in  visual  information  priocessing. 
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Procedure: 

•»  —  -  / 

The  stijnulus  materials  used 'in  the  study  were  the  same  as  those  used  by 
Berry  (1977),  Wieckowski  (1980)  i'and  Lertchalolam  (1981).    These  consisted 
of  150  stimulus  slides  and  90  distractor  slides.    All  slides  were  obtained 
from  a  pool  of  tvavel  and  geographic  scenery,  slides  taken  by  several  amateur 
photographers  in  various  parts  of  the  United  States  and  Canada.    In  selection 
of  the  materials,  care  was  exercised  to  exclude  all  recognizable  human  figures, 
verbal  materials  and  unique  objects.    The  entire  collection  of  materials  was 
randomly  divided  into  approximate  thirds.    One  third  was  retained  as  a 
realistic  color  group,  a  second  third  was  recopied  into  black  and  white  slides/ 
and  the  remaining  third  was  altered  by  photographic  reversal  to  produce  a  non- 
realistic  color  group.    Through  photographic  reversal,  the  overall  number  of 
color' cues  could  be  held  constant,  vAiile  the  degree  of  color  realism  could 
be  manipulated.  *  . 

The  population  for  the  study  consisted  of  60  students  at  the  University 
of  Pittsburgh.    Subjects  were  drawn  fran  the  Schools  of  Education,  "Library 
and  Information  Science  and  Business  and  represented  both  graduaite  and  under- 
graduate students. 

Subject's  relative  degree  of  field  dependence/independence  was  determined 
using  the  Group  Embedded  Figures  Test  (GEPT)  (Witkin,  Oltman,  Raskin  and  Karp, 
1971).    Based  upon  similar,  data  from  related  populations.  Cutoff  points  of 
11  and  15  were  used  to  define  field  dependent  (11  and  below)  and  field  in- 
dependent (15  and  above)  groups.    To  avoid  the  loss  of  power  associated  with 
three-level  blocking,  described  by  Cronbach  and  Snow  (1977),  the  middle, 
indeterminate  group  was  deleted  frcm  the  study.         *      "  " 

The  list  learning  proc^ure  was  enployed,  in  which  all  subjects  were 
•first  shown  the  group  of  150  stimulus  slides,  sequentially  for  approxiinately 
500  ms  each.    Subjects  were  subsequently  presented  with  a  random  distribution 
of  all  slides  (stimulus  and  distractor)  for  five- seconds  each.    During  that 
time;  subjects  responded  in  writing  either  "old"  (stimulus  slide-seen  before) 
or  "new"  (distractor  slide-never  seen). 

.  •      .      1  . 

The  design  of  the  stuc^  followed  an  ATI  configuration  with  ,two  levels  of 
the  aptitude  factor  and  three  repeated  measures  of  the  color  factor. 

Findings; 

•Ihe  mean  nunber  of  hits  for  each  treatment  and  cognitive  style  group  as 
well  as  the  measure  of  sensitivity  d«  which  was  determined  from  tables  developed 
by  Elliot  (1964)  are  presented  in  Table  1.    In  addition,  total  mean  error 
rates  for  each  treatment  were  calculated  (total  error  rate  =  false  alarm  rate 
+  miss  rate)  as  suggested  by  Loftus,  Green  and  Smith  (1980)  (see  Table  1). 

Analysis  of  variance  procedures  for  repeated  measures  were  conducted  on 
the  number  of  hits  (recognition  scores),  d'  and  the  total  error  scores. 
Significant  F-valus   were  obtained  for  the  main  effect  of  .color  on  the  hit 
rates  (F=7.10,  p=.001)  and  for  the  main  effect  of  cognitive  style  on  the  d' 
data  (B^7.59,  p=.008). 
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Table  1 


Means  ancl  $t^dard  Deviations  Tor  Nuinber-C3f-Hi±S7 
d'  and  Ttotal  Error  I?ate  by  Treatnents  Across  Cognitive  Style  Groups 


Realistic  Color 
l/\e;an.  s.d. 

Non-Realistic 
^  Colorl 

Mean  js.d. 

Black  and  White  . 
Mean  S;d. 

Field 

Hits 

26.74' 

9.41 

1 

24.33  / 

9.94 

20.56 

10.85 

Dependent 
(N=27) 

d' 

.133 

^172 

■    .107  j 

.336 

.200 

.°392 

Total  - 

37.89 

4.29 

39.63  ^ 

6.58 

39.78 

6.61 

Error 

/ ' 

Field 

Hits 

25.82 

7.90 

.  / 
23.33. 

9.98 

22.48 

8.08 

\Independent 
W=33) 

d' 

'-195 

.327 

.369 

.389 

,278 

.248 

Total 

37.48 

5.01 

36.85 

5.91 

38.24 

4.16 

Error 

/ 

ThexScheffe  procedujr^  for  pair-wise  ccnparisons  was  perfomed  on  the  ^msans 
to  determine  where  significant  differences  existed:    The  results  of  these 
analyses  are  siaimarized      Table  2.  ^- 

'\  Table  2/ 

 7   i  ^ 

Suimiary  of  statistical  analyses  for  hit  scores,  ^ 
'    (i'  and  total  error  scores 


Hit  Scores 


d' 


Total  Error  Scores 


RC  >  BW 


FI  >  BD 


Discussicai  and  Conclusipfig^; 

'       Findings  relative  tP  the  cognitive  style  variable  of  field  dependence 
showed  no  differences  in  Analysis  of  the  hit  rates  (recognition  score),  however 
a  significant  main  effect  for  the  cognitive  style  attribute  was  produced  on 
the  d'  paraneter.    This  Atiding  would  suggest  the  general  superiority  of  field 
independent  subjects  in        type  of  pictorial  recognition  task  regardless  of 
color  mode.    Such  repuXtS'  are  consistent  with  current  theory  which .  suggests 
that  field  dependent  individuals  are  better  able  to  in|»se  structure  on  a 
relatively  undifferentiated  field  and  consequently  can  more  effectively 
process,  store  and  retain  such  information.    Color  was  not  identified  as  a 
significant,  contributing  factor  to  this  figured  restructuring.    It  should 
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be  noted,  however,  that  in  the  non-realistic  treatment,  subjects  showed  the 
greatest  degree  of  differentiation  across  the  cognitive  style  factor.  ..  This 
may  suggest  that  when  individuals  are  presented  with  unique  or  unfanaliar 
visual  displays,  field  independent  persons  use  such  information  nore 
effectively  than  do  field  dependent  subjects.    Such  ca.parisons    would  seem 
to  metit  further  investigation. 

Since  subjects^showed  no  apparent  difference  in  terms  of  overall  error 
rate  or  hit  rate,  it  would  seem  reasonable  to  conclude  that  the  difference 
produced  in  the  d'  variable  is  due  to  differences  in  the  "false  alarm"  rate 
(positive  response  to  distractor) .    This  -ijiplies  a  greater  processing  and  , 
storage  problem,  possibly  attributable  to  less  efficient  organization  of 
the  material  in  memory.    Again,  this  aspect  calls  for  more  extensive  ex-  / 
ploration.  / 

.  In  terms  of  the  color  variable,  the  analyses  of  hit  scores  (correct  / 
recognition)  showed  no  interaction  with  the  cognitive  style  variable,  but/ 
did  show  a  main  effect  superiority  for  the  realistic  color  treatment  over 
the  black  and  v*iite  treatrresnt.    No  differences  were  produced  however,  in 
analyses  of  the  d'  values.    Such  variations  are  again  the  result  of  differ^ 
ences  in  the  false  alarm  rate.    It  would  seem  that  even  though  realistic 
color  materials  produce  greater  recognition  values,  they  also  produce /higher 
false  alarm  rates.    This  would  suggest  that  the  use  of  realistic  color 
materials  may  not  be  as  efficient  in  terms  of  the  accuracy  of  the  response. 
Such  a  finding  also  suggests  that  the  d'  parameter  is  a  better  overall 
indicator  of  response  accuracy.  / 

Based  on  these  findings,  a  number  of  conclusions  can  be  drawn. 

1.  Field  inc3ependent  subjects  exhibit  greater  ability  to  recognize 
previously  seen  visuals  in  terms  of  the  d'  parameter.  / 

2.  Realistic  color  naterials  tend- to  produce  higher  absolute  recognition  y 
rates  but  not  higher  d'  values.      ^  ^ 

3.  The  variables  of-false  alarm  rates  in  relation  to  overall' recognition 
should  be  studied  further.  / 

4.  The  method  of  signal  detection  theory  can  and  should^  be  aj^lied  to 
color  recognition  data  analysis.    In  so  doing,  a  mpre  accurate 
assessment  of  the /recognition  and  error  rate  inteijaction  can  be  made. 


/ 

/ 

/ 


/ 
/ 

/ 


/ 
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The  Role   of  Naturalistic   Inquiry  onJ  Res'earch   In  the 
'  Instructional  Uses  of  Pictures 

Since  its   Inception  as   a   field   of   study^  Instructional 
technologists  have  used  the  scientific  or  rationalistic 
paradigm  to   study   the  Instructional  potential  of  pictures. 
In  spite  of   numerous   studies   concerned  with  different 
aspects   of   pictures,   concern  has  been  raised  about  the 
products   of   such  research   to   Influence  practice  (Clark, 
1983;    Brody,    in  press).      Some^ have  pointed   out   that   it  is 
difficult   to   apply   the  results  of   this  research   to  the 
classroom  because  the  conditions  under  which   the  research 
has   been   conducted  are   too   far  removed   from   the  realities  of 
the   typical   instructional   setting   to  be  very  meaningful. 
That   is,   many  have  concluded   that   emulating   the  practices  of 
physical   scientists  may  be  inappropriate  for  social 
scientists  who   are  primarily  concerned  with  human  beings  and 
their  problems. 

This  attention  to   the  apparent   lack  of   utility  in 
research   spreads   far  beyond   those  whose  Interests   lie  in  the 
study   of   pictures   of   instructional  technology;    rather   it  has 
become   a  recurring   theme   sounded  by  a  broad   spectrum  of 
educational  practitioners   and   researchers.     While   some  have 
Ignored   this   concern  over   the  lack  of  utility,    others  have 
looked   to  newer  methods   of   educational   inquiry.      Of  the 
newer   paradigms,   naturalistic   inquiry  have  received   the  most 
attention   and. may  have' the  greatest  potential   to  Influence 
the'  practices   of   instructional   technology  research  in 
general   and,-   more  specifically,   research  on  the 
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Instructional  uses  of  pictures. 

Although  an  analysis  and  description  of   the  techniques 
^^>4nd  procedures   of   naturalistic  Inquiry  is  not   the  major 

focus   of   this   paper,    an  understanding   of   the  basic  elements 
of  naturalistic   inquiry  is  necessary  before  one  can 

understand  how  It  may  be  used   to   study   the  ins  true tlonal 

A 

potential   of   pictures.      Thus,    the  next   section  of   the  paper 
will  briefly  describe  the  major   components  of  naturalistic 
inquiry  and   to  better  understand   these  characteristics, 
briefly  compare   them  to   the  major   assumptions  of 
rationalistic   inquiry  with  which  we  are  more  familiar  (Cuba 
&  Lincoln,    1982;    Smith,    1983).      Following   this  will  be  a 
more  specific   discussion  of  how  these  characteristics   can  be 
used  in  picture-related  research. 

Basic  Assumptions   of   Naturalistic  Inquiry 
Probably   the  major  difference  between  the  two   types  of 
research  lies   in   their  different  views   of   reality  and  truth. 
The  naturalist  believes  that  reality  is  multlf aceted  and 
that   Identifying  what  is  real  depends  on  individual 
experience   and   interpretation .      Furthermore,    advo.cates  of 
naturalistic   inquiry  believe  that   one  can  only  study 
phenomena  as   coherent   entitles,    that   should^not  be  separated 
into  its   constituent  components.      On  the  other  hand,  the 
rationalist  believes   that   there   exists  a   single,-  viable, 
concrete   truth  and   that  one  can   study  phenomena  by  examining 
small  components   of   that  phenomenon.      The  truth  could  then 
be  identified  by  combining   the  results  of   the  various 
research  on  the  cons tltuent  par ts . 
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A  second  difference  between  the  naturalistic  and 
rationalistic  paradigms   concerns   the   relationship  between 
the  Investigator  and   the  subject.     The  naturalist  believes 
that   Investigators   and   their   Instruments  will  always 
influence  and   Interact  with  the  subject.      This   is   In  marked' 
contrast  to   the  rat lonallst  belief   that   Investigators  can 
maintain,  a  safe  distance   from  that  which  Is  being  examined 
and   that  methodological   safeguards  can  be  Implemented  to 

o 

help   ensure  that   the  act   of   Investigation  does  not 
Influence  the  outcomes   of   that   Invest igatlon . 

The  development  and   formulation   of   generalizations   Is  a 
linchpin  of  research  based   on  the  rationalistic  paradigm. 
Such  statements   are  usually  considered   true  under  all 
environmental  and   contextual   situations.      The  naturalist, 
however,   believes   that   It   Is   Impossible  for  phenomena  to  be 
free  from  contextual   Influences .   Thus,   naturalistic  Inquiry 
does  not  generally   support   the  attempt   to  develop 
all-encompas sing  generalizations. 

The  manner   In  which  rationalistic  and  naturalistic 
Inquiry  view  the  goals   of   Inguiry  Is  yet  another 
characteristic  which  distinguishes   the  two  jiaradigms.  The 
manurallst  maintains   that   the  complexities  of  being  human 
are  so   enormous   that   determining   causality  is  a  futile  goal. 
Instead,   naturalistic   inquiry  emphasizes   the  need   to  develop 
a  broad,   interpretive  understanding   of  what   is,  taking  place. 

{V. 

Whereas  understanding   is   the  major  goal   of  naturalistic 
inquiry,   determining   causality  is   the  ultimate  goal  of 
rationalist   inquiry.      That   is,    the  primary  purpose  of 
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inquiry  ba'sed  on  the  rationalistic  paradigm  is   to  explain 
the  relationship  bietween  different  elements   in  the 
educational  setting   and  use  these  relationships   to  develop 
universal  laws  of  behavior. 

Finally,   naturalistic  and  rationalistic   inquiry  differ 
in   the  way  each  approaches   the  role  of .  values   in  inquiry. 
The  naturalist   supports   the  notion  that  values  are  always 
part   of   inquiry  and   that   the  investigator   can  identify  and 
acknowledge  the  relevant  values   so  that  they  can  be  utilized 
in   interpreting  the  phenomena  being  examined .  In 
comparison,   researchers  using  the  rationalist  paradigm 
believe  that   through  the  use  of  objective  methodology, 
inquiry  can  be  conducted  which  is^  free  from   the  values  of 
the  investigator.      If  values  free,   then  the  results  of 
inquiry  can  be  considered   to  be  representative  of  what 
actually  exists*. 

Naturalistic   Inquiry  and  Picture  Research 

Although  other   areas  of   education  have  attempted  to 
employ   the  methods   of.  naturalistic  inquiry,  educational 
technology  in  general,  *and  the   study  of  pictures  in 
particular,   have  not  yet   determined  how,  the  naturalistic 
paradigm  can  be  of   assistance.      This  section   of   the  paper 
will   try   to  provide   some   initial,    if  halting,   reflections  on 
how  our  understanding  of   the  instructional  potential  of 
-pictures   can  be  expanded  by  conducting  research  based  on 
naturalistic  methodologies.     Rather  than  pointing  out  how 
each  research  decision  relates  to  one  of   the  elements  of  j 
naturalistic  inquiry  described  above,   only  the  most  subtle 
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or  significant  connections  will  be  indicated  otherwise  it. 
will  be  left   to   the  reader  to  make  these  associations. 

\ 

While  numerous  , studies  using  the  rationalist  paradigm 

\ 

have  been  conducted,  we  know  little  about  how  pictuxes,  when 
included  in  instructional  texts,   are  actually  used  by 
students  and   teachers.      It   is  also  doubtful  whether 
rationalist  research  with  its  emphasis  on  highly  structured 
and  artificial   treatments  will  ever  be  able   to  accu^rately 
describe   this   set  of  behaviors.      On  the  other  hand,^ 
naturalistic   inquiry  with   its  emphasis  on  conducting,  studies 
in  their  natural  settings   and  qualitative  research 
techniques  would  seem  well-suited,  to   examine  hov  pictures 
are  used  by   students  and   teachers. ^    Let  us   now  examine  the 
form  such  research  may  take. 

First   of   all,   this  research  would  take  place  in 
schools,   under  no rmal . ins  true t ional   settings.  Unlike 
rationalist-based  research,    there  will  not  t3  any 
manipulation  of   independent  variables.      Instead,   members  of 
the  research   team  will  spend   considerable  time  observing  how 
■--dTffef  ent-fc'eacrer   r-eading-,-- as 


\ 


well   as  how  students  use  them  when  readying  a  variety  of 
instructional  texts.     The  team  may  also   observe  teachers 
when   they. are  planning   their  lessons  and  students  when  th^y 
are  doing  homework.     Additionally,   both  teachers  and 
students  will  be   interviewed   extensively,   and  asked 
•     questions   about  how  they  used  pictures,   which  pictures  thej)^ 
liked  or  disliked,  which  ones  helped  them  the  most,   and  any 
other  qu-stions  which  the  interviewer  thinks  relevant.  >  The 
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ability  o/  interviewers  to  formulate  questions  as  they  go 
along  and  to  alter   the  questions  from  subject  to   subject  is 
in  marked  contrast   to  rationalistic  inquiry  which  almost 
demands   that   identical   questions  be  asked   to  all 
respondents. 

To   increase  the   trustworthiness   of   the   study,   it  is 
also   likely   that   there  would  „be  a   team  of   investigators  who 
will   observe   the   same  classes  and' int erview  some  of   the  same 
peopleT    All  of   the  observers  and   interviewers  would  expend 
considerable  effort   in  describing   the  instructional 
environment   and   context.      The   types   of   pictures  used, 
outcomes   expected,    teacher  behavior  patterns ,  learner 
behavior,    subject  matter,   and   instructional   strategies  are 
just   some   of   the  many  factors   that  would  be  noted  by  the- 
researchers.      Finally,    the  research  team  would  spend 
considerable   time   at   the  study   site   to   reduce  the 
-possibility   of   distortion  due   to   the  presence  of  the 
investigation  team  at   the  school  and   to   ensure   that  the 
important   environmental  and  contextual   characteristics  have 

been  identified. 

The  result   of   all   the  observations   and   interviews  will 
be  a  fairly  substantial  set  of  descriptive  notes  which  the 
investigator  must   reduce  to  a  more  ceaningful  and  manageable 
size.      As   the  data   is   sifted,    orgainzed,   and  refined, 
recurring  patterns   are  identified.      In   the  hypothetical 
study  concerned  with  how  pictures  are  used  when  they  are 
incorporated  into   instructional  texts,   patterns  related  to 
some  of   the  following  may  emerge: 

5i 

62 


V  Page 
■  « 

--the  way  students  used  pictures   to   Increase  their 

understanding  of   textual  material 
—  the  way  pictures  are 'uised  by   students  with 

different  characteristics 
--which  combinations  of  pictorial  attributes  are 

p  r e s en t_j^h en^.s_t .u_d_en_t s  b el i  e v ed-  a— p i c  t u r  e  wa s 

particularly  helpful 
--the  extent   to  which  pictures   influenced  teacher 

behavior  .   *  . 

--the  .relationship   between  pictures,    student  behavior 

and  different   types   of   subject  .matter  and  learning 

outcomes 

--the  procedures  used  by  students   to   gain  meaning  from 
pictures 

Unlike  more  conventional  and   traditional  research  r 
p;ractices,   no   attempts  would  be  made  to   infer  causal 
relationships   for   the  pat  terns   identified ,   nor  would  there 
be  an  attempt   to   use   the   results   to   explain  what  had 
occurred  or   to  predict   outcomes   in  other  settings.  Instead 
the   investigator  would  most. likely  try   to  use   the  patterns 
identified  as  a  means  of   increasing   the  understanding  of  th 
phenomena  being   examined-- the  manner   in  which   students  and 
teachers  use  pictures   included  in  instructional  texts. 
Rather' than  using   the  data  to  prove  or  disprove 
generalizations  or   theories,    the  investigator  would  use  the 
data  to   sharpen  the  focus  for  the  next   series  of   studiesl-  ' 

The  number  and  variety  of  possible   subsequent  studies, 
emerging  from  the  initial,   hypo thet ical  ^ tudy  is  impressive 
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Studies  in  settings   similar   to   those  described  previously 
could  be  conducted  to   determine   the  consistency  of  the 
observations  across   similar,   yet  different,  settings. 
Taking  a  different  approach,   a  future  investigation  could 
focus  on  one  of   the  patterns  or   combinations   of  patterns 
which- seem  incongruent  with  previous  research  or  which  the 
investigator  wishes   to   explore xin  greater  detail.      There  is 

0 

no   reason,    for   example,   why   futurci  studies  utilizing  the 
techniques   of  naturalistic   inquiry  could  not   examine  the 
procedures  used   to,  gain  meaning   from  pictures,   regardless  of 
whether   or  not   they  are  included   in  an  instructional  text. 
Similarlyi,    one  could   conduct   a   study  concerned  with  the 
influence  of  pictures   on   the   instructional  behaviors  and 
strategies   of   teachers.  v 

Conclusions 

The  hypothetical   study  brief ly described  above  is  -but 
one  of  many  areas  related   to   the  instructional  uses  of 
pictures   that   could  be  conducted  within  the  framework  of  ,/ 
naturalistic   inquiry.      Determining  the  types  of 
instructional  functions   that   can  be  served  by  pictures  or 
examining   the  role  of   pictures  wi th in  a  g iven~co^ 


for  a  specific   type  of   learning  outcome,   or  for  a  particular 
type  of   learner  are  all  potential  candidates   for  research 
utilizing  the  naturalistic  paradigm. 

What   is  most  improtant   to   the  instructional 
technologist   concerned  with   examining  the  ins  true tional 
potential   o f  p-i c.t u_r e s   is   not   the  identification  of  specific 
questions  which  can  benefit   from  naturalistic   inquiry,  but 
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to  understand  and   take  advantage  of   the  .unique 

-  ,        i  ■ 

characteristics  of   this  mojde  of  research.      It  would  appear 
most  appropriate  to  develojp  a  study  around^  naturalis  cic 
methods  when  it   is  necessary  to  provide  an   excep t io ually 

large  data  base  for  a  prevjiously  ignored  area  of  picture 

'  ■  '  i  ■  ■ 

1  ■ 

research:    to   determine  what  occurs  in  actual  instructional 

I. 

settings:    to   generate  working  hypotheses   for   future  studies 
when  none  are  available;   or   to   simply   to   increase  one's 

■  i      .  •        ■   '  ■ 

understanding  of   the  complexity  of   a  problem  area. 

It   is  probably  equally  important   to  recognize   that  it 

is  unlikely   that   inquiry  based   on  either   the  naturalistic  or 

\  1 
rationalistic  paradigm  wili  answer   all  our   questions  about 

I  ,  ■  ■ 

the  instru_ctional  uses   of  pictures.      Instead,    it   is  likely 

■       \    ^  ^ !  ■ 

that  each  paradigm  will  haVe  an  itaportant  role  to   serve  in 
increasing   our   understanding   of   the   relationship  between 
pictures  and . effective  instruction.      On  the  other  hand, 
instructional   technologist s  have  almost   totally  ignored 
naturalistic   approaches   to   this   area  in  favor  of   the  more 
conventional  rationalistic  approaches*     One  can  only  wonder 
if  we  have  failed   to   take  ,  advan  t  ag-e  o  f  a  potentially 
powerful  ally.  ' 
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^est i ng  and  Measurement  Potent i al s 
of  Mierocomputers  for  Cognitive  Style  Research 
and   Indivi dual i zed  Instruction 


/ 


At  present ,   many  of  the  instruments  used  to  measure  an 

individual  's  cognitive  style  are  ^susceptible  to  a  variety  of 

potential   errors,   must  be  individually  admi ni stered ,   or  are 

otherv^!ise  logistically  uneconom ' /cal .     For  example,  Ihe 

Level iQgzSharBening_HQuse_^  1964)  is 

individually  admi nlstered  and  requires  that  the  hand-held 

pictures  be  display  f  ivq -seconds  each .     Lowenf eld 's 

Successive^Imaressions^^  employs  a  film  presentation 

that  requires  the  subject  to  respond  within  a  rel ati vel y . short 

period  of  time  in  order  to,  keep  up  with  t:ie  film's  pace  of 

I     ■  ■  / 

presentation.^    The  GrouB_Embedded_FLgures_Ie^     (Witkin,  Dltman, 

Ruskin,   and  Karp ,    1971)   uses  a  32-page  booklet  for  each  subject 

tested.  "  \  . 

Over  the  past  seven  and  onfe  half  years,   microprocessors  have 
become  increasingly  available  wiVhin  our  schools,   and  will  become 
even  more  widespread  in  years  to  come.     With  this  growth  in 
ailicrocomputer  use  and  the  i ncreasing  emphasis  on 

individualization  of  instrviction,   the  need  for  student  diagnostic 
tools  that  are  dependable,   reliable\^  precise,   and  efficient  will 
also  grow. 


\ 

\ 

\ 
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^1icro^□mputerH  are  dependable  machines.      In  the 
fivtr  year  history  ot  the  mi crocomputer  teaching  lab  at 
the  University  of  Oklahama,   time  lost  due  to  equipment 
failure  has  bet-r^  negligible  despite  heavy  use  by  inexperienced 
and  accident  prone  students,   staff  and  faculty. 

Microcomputers  are  precise.    ""When  instructed  to 
display  a  sequence  of  'Screens  for  five  seconds  each,  it 
will   display  each  screen  in  the  prescri bed  sequence,  at 
the  same  viewing  angle,   and  wi thout . tremor ,   for  exactly 
five  seconds. 

Microcomputers  are  economical.     Once  the  microcomputer  has 
been  purchased  and  a  rela+-ively  small   amount  h^s  been  spent  for 
software,  the ^cost  of  administration  of  d iagnosti c  tool s  on  an 
individual  basis  to  an  unlimited  number  of  students  -s  limited  to 
the  cost  of  electricity  for  a  low  consumption  instrument,   and  an 
occasional   two  dollar    reusable  floppy  disk  for  data  storage. 
Many  tests  can  be  scored  by  Lhat  same  microcomputer.     Yet  another 
consideration  is  that  microcomputer  programs  can  be  developed  in 
a  way  that  requires  virtually  no  prior  experience  with  either  the 
_c,ompjater_or_i^th  typewriter  keyboards.     The  user  responses  can  be 


gathered  with  the  press  of  a  single  key   (sometimes  any  key). 
Peripherals  such  as  game  paddles  or  joy  sticks  allow  cursor 
control  and  response  to  onscreen  pronr  )ts  with  the  spin  o-f  a  knob 
or  the  push  of  a  button.     Light  pens,   graphic  tablets,  touch 
screens  and  thci'   'mouse'   all   simplify  user  input. 

The  graphic  capabilities  of  many  microcomputers  are  perhaps 
the  asset  that,  most  enhances  their  value  in   the  delivery  of  ,1 
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cognitive  style  diagnostic  and  research  tools.     Being  able  to 
display  pictures '.in  high  or  low  resolution  in  either  color  or 
black  and  white,  these  microcomputers  can  replicate  the  test 
stimuli   that  are  used  in  many  o-f  the  commonly  used  test^.  These 
same  graphic  capabilities  may  also  be  used  to  display  text  -font 
sets  -for  di-f-fent  languages  and  in  various  sized  to  accommodate 
the  young  and  those  with  visual   handicaps.  ^ 

The  remainder  o-f  this  presentation  will   describe  and  demon- 
strate'mi  crocomputer  versions  o-f  three  commonly  used  tests: 
Il3e_GrouE_Embedded_Figures_Iest  -for  Field  Dependence-Independence 
(Witkin  et  al,   1971),   Jhe J^eyeUQgrSharEeni ng_House_Iest  -for  the 

I 

Level  ing-Sharpening  cognitive  control   principle   (Santoste-f  ano, 
1978),   and  Ihe.Successiye.PerceEtigns.Ies^^     -for  the  Visual- 
Haptic  perceptual   styles   (United  States  Army       r  Corps ,   1944)  . 

Ihe_,Groue_i!Dbedded_Figures_Iest 
Ihe„GrDUE_E(nbedded_Iest    (GEFT)   was  derived  -from  Ihe_Ernbedded 
Figures_Iest    (EFT)    (Wit ken,    1950)   to  -facilitate  group  testing. 
In  each  o-f  the  18  test  -figures  taken  -from  the  EFT,   one  o-f  eight 
simple  -figures  is  incorporated  into  increasingly  complex  -figures 

-  c 

so  the  extensions  o-f  the  lines  composing  the  simple  figure  make 
UP  elements  o-f  the  complex  f  i  gure.    (See  Fi  gureM )  .  .  There-fore, 


the  simple  -figure  tends  to  blend  with,   or  is  embedded  within,  the 
Surrounding  visual   -field.     Disembedding  the  simple  -figure  -from 
the  complex  -field  is  a  task  that  the  -field  independent  subject 
should  be  able  to  accomplish.     Results  o-f  GEFT  testing  have  been 
consistent  with  those  -from  theEFJ,   Ihe.Rod,  and  .Fr ame.Iest"  and 
Ihe_BodM_Adiustment_Ie5t   (Witkin,   Moore,  "Soodenough  &  Cox,  1977). 
the  EFT  used  colors  to  emphasi'ze  the'' large  organized  -field 


  tli  crQ '  Poireniil-a-l-s-^ 

and  obscure  the  simple  -figure.     The  GEFT  has  accomplished  this 
through  light  shading  of  similar  areas  on  each  -figure. 

During  administration  o-f  the  GEFT,   the  si mpl -figures  are 
printed  on  the  back  cover  of  the  booklet  while  the  complex 
figures  are  on  the  right  side  of  each  inside  page.     This  is  to 
prevent  the  individual   from  seeing  the  two  simultaneously, 
although  they  may  look  from  one  to  the  other-     This  is 
accomplished  with  the  microcomputer  by  using  graphics  pages  one 
and  two  and  allowing  the  subject  to  toggle  bac}c  and  forth. 

Streibel    (1980)   reports  finding  decreased  differentiation 
between  the  cognitive  styles  with  increasing  stimulus  size.  This 
imposes  a  . limitation  on  the  size  of  the  monitor  screen  used  for^ 
testing.   ^  The  ffgures  used  in  the  mi crocomputerized  version-  were 
developed  to  the  same  scale  as  the  paper  and  pencil   version,  on 

an  11"  monitor,  a  very  commonly  used  monitor  size. 

^  "i  ■  ■ 

f  The  GEFT  is  administered  in  three  sections.     Following  a 

sample  figure  and  splution,   the  subject  is  given  two  minutes  to 

"complete  First  section,   five  minutes  for  the^  Second  Section,  and 

five  minutes  for  the  Third  Section.     This  is  duplicated  in  the 

microcomputer  version.  ^ 

______  --In-trhe-paper-^aTid-^penrtr-GEFTv^^^^^ 

outline  of   the  simple  figure.     This  has  been  accomplished  with 

the  microcomputer  version  by  using  a  LPS  II  graphics  light  pen 

from  Gibson  Laboratories,   with  which  the  subject  can  draw  a 

colored  outline  over  the  simple  figure.     This  new  composite  is 

stored  on  a  floppy  disk  for  later  scoring. 

.  "  #  ■ 
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X!2e_Leyel  ing.-SharBening_Hou5B_Iest 
IhB_LBvelingzSharBenlna_House_Ie5t   (LSHT)  was  developed  by 
Santoste-fano   (l'97a)'  to  relieve^  the  tedium  and  boredom  that 
subjects  encountered  with  the  earlier  Schemat i = 1 DQ-ifly^d^^-I^^fe ' 
and  to  add  the  conceptual  -familiarity  -for  younger  children  not 
■found  in  the  Level  ingzSharEening_Circles_Iest  yet  still  Have 
adequate  complexity  -for  the  older  chi  Id.  that  was  not  present  in 
the  Level  ingrShar  gen  in  g_Wagdn_Ie5t    (Santoste-fano,    1964).  The 
LSHT  is  described  as  being  e-ffective  with  subjects  -from  three 
years  o-f  age  through  adulthood    (Santoste-fano,  1978). 

The  LSHT  consists  o-f  a'  series  o-f  60  handheld  test  cards,  the 
first  o-f  which  shows  a  black  and  white  line  drawing  o-f  a  house 
and  adjacent  landscape   (See  Figure  2).     The  cards  are  shown  for 
five  seconds  each.     On  every  third  card  a  picture  will   have  some 
detail  omitted  until   by  the  58th  card,    19  elements  are  missing  ^ 
from  the  original   scene.     Less, conspi cuous  elements  are 
eliminated  in  the  earlier  frames  and  more  conspicuous'  ones  later. 

The  subject  is  instructed  to  study  each  card  and  then,  when 
the  next  card  is  shown,   to  stop  the  examiner  if  any  changes  are 
noted .     When  d  i  r  ec  t  ed  by  the  subject  to  "Stop       the  ex  ami  ner. 


records  the  subject's  response,   whether  correct,   incorrect  or 
imagined. 

The  examiner  begins  by  raising  the  deck  of  cards  so  that  the 
subject  sees  the  first  card.     Observing  a  stopwatch,   after  five 
seconds,  the  first. card  is  laid  face  down  so  that  the  second  card 
is  seen.     This  sequence  is  foil  owed ,. pausi ng  to  record  the  • 
subject's  responses,   until  all  60  cards  have  been  shown. 
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The  Level ing-Sharpening  cognitive  control  principle  deals 
with  how  an  individual   organizes  i  n-Format  i  on  images  in  memory  and 
subsequently  relates  those  images  to  current  information.  A 
person  who  is  a  leveler  has  a  global   image  with  which  ni3W 
information  is  fused,   whereas  the  sharpener  different:. ates 
between  memories  and  present  information.     Therefore,   on  the 
LSHT,   the  sharpener  should  more  quickly  and  accurately  detect  the 
changes  in  the  scene- 

The  Leveling-Sharpening  ratio  is  determined  by  changes 
detected,   changes  not  detected,  and  how  quickly,   in  number  of 
frames  from  item  deletion,   the  changes  were  detected*  The 
greater  the  number  of  changes  noted  and  the  faster  the  changes 
are  noted,  the  lower  the  L-S  ratio  will  be  arirf  t;-uv;a'ore  Uhe 
greater  the  tendency  toward  sharpening- 

The  need  for  manipulating  handheld  cartrB^  v3^;Lc;hing  a 
stopwatch  and  concurrent  recording  of  the  £      jsT:t ' responses 
introduce  the  possibility  of  variable  precir.^;;au   .n  administering 
the  LSHT.     This  potential,   as  well   as  having    loted  a  need  for 
administration  technique  that  elimin>^tes  the  nti-cessity  of  havi  i> 
a  trained  examiner  pr^asent,   led  Ragan  and  Dillingham   (1979)  to 

 ^   du.yelpp  a  mi crocomputeri zed  version  of  the  LSHT  that  in  in 'oriral 

trial   has  shown  no  apparent  difference  in  aoult  subject 
rt  sponsef^,  .       '  ^ 

The  microcomputer  vcxrsion  of  the  LSHT  is  accurate  and 
precise  in  E^.timulur.  detail   and  in  presentation  timing.     As  the 
standard  scsnes  are  presented  on  8  m   11   inch  cards,   accuracy  of 
duplication  for  the  computer  requires  using  full   screen  graphics 

63 

ERIC  74 


Micro  Potc^ntials  ,7 

on  a  13  inch  monitor. 

To  obtain  the  desired  advantage  of  rlimi;u.ting  the  need  -for 
a  trained  examiner  to  monitor,   clarify  and  rrrcord  responses,  the 
subject  may  type  their  responses  on  the  keybOwHrdu     The  computer 
will   then  tag  the  entry  with  the  frame  numbc^r  and  store  it  on 
disc  for  later  interpretation.     This  raises  Ihe  question  of 
whether  or  not  a  typed  response  will  retain  the  spohtanr;:?! ty  and 
form  that  is  obtained  from  an  oral  report-     Also,  v;hen  present 
during  the  testing,  the  examiner  may  clarify  any  unclear 
responses  before  interpretation. 

An  associated  and  probably  greater  drawbacK         th^t  even  if 
keyboard  entry  is  shown  to  be  no  significant  distriment,   this  will 
probably  hold  most  tVue  -for  the  relatively  sicnied  typist  with  at 
least  moderate  written  communications  skills.  ^  The  hunt-and-peck 
typist,  and  those  with  poor  writing  skills,  will   likely  become 
distracted  and  -frustrated,  reducing  the  validity  of  data  \ 
gathered.     It  is  also  difficult  to  imagine  many  three  to. five 
year  olds  being  able  to  effectively  enter  i.nfDrmation  this  way. 

the  microcomputer  version  of  the  LSHT  was  developed  to  be 
used  by  adult  subjects.     For  those  who  have  difficulty  with 
keyboard  response  entry,  the  'test  would  retain  the  value  of  its 
stimums""pT¥sl5^'tir^^  by  "having  a -trai  ned  observer^ 

pres(?nt  for  data  gathering. 

The_Successi ye_ImBressi ons_Iest 
As  described  by  Lowenfeld    ( 1945) i  Ihe_Iest_For_lntegratign 
cf .Successive  IfDeressi ons  requires  the  subject  to  integrate  a 
series  of  partial  impressions  into  a  whole.     This  ability  belongs 
to  a  person  of  the  visual  perceptual  style,  rather  than  the 
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haptic  who's  perception  is  primarily  through  the  kinesthetic  and 

tactile  modalities. 

Ihe^Successiye^ImECeiiiens^Iest^I    (SPI-I)   is  a  version  of 
Lowen-feld's  test  presented  on  film  for  group  administration.  The 
SPT-I  is  composed  of  three  practice  and  thirty  five  test  items. 
The  subject  is  presented  a  blank  screen  with  a  narrow  window  that 
moves  from  the  top  to  the  bottom  of  the  screen  in  one  second, 
successively  revealing  parts  of  a  line  drawing.     The  subject  is 
instructed  to  attempt  to  visualize  the  parts  as  a  whole  figure. 
Then  the  subject  is  shown  a  screen  with  the  intact  figure  and 
four  similar  drawings,  and  is  instructed  to  choose  the  correct 
figure.    (See  Figure  3).     The  subject  then  records  his/her 
selection  on  a  paper  score  sheet." 

The  score  is  the  number  of  correct  responses.     Ragan ,   et  al . 
(1979)   summarize  the  research  in  this  typology  and  report  a 
distribution  of  50"/.  visualizers,  257.  haptics,  and  35'/. 
indetermi nates.     This  converts  to  scores  on  the  SPT-I  of  18-35 

0 

correct  visual,  0-9  correct  haptic,   and   10-17  correct 
indeterminate. 

A  modification  o-f  the  SPT-I  -for  microcomputer  delivery  has 

been  done  by  Edu-Ware  Services,    Inc.    (copyright   1979) ,   under  the 

title  PerceBtign_I I .     This  version  allows  the  user  to  determine 

the  number  of  verticies  of  the  target  drawing ^and  the  degree  of 

variation  between  the  target  and  the  incorrect  figures  on  the 

matching  screen.     Perceeti on_I I  reports  the  number  of  correct 

responses  and  a  score  based  on  the  difficulty  of  the  items  used. 

This  program  is  not  described  by  the  author  as  a  cognitive  style 
test. 
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The  author  is  presently  developing  a  version  that  will 
replicate  the  SPT-I.     Lowenf eld   (1945)   gives  no  indication  of 
object  ^ize  or  duration  of  exposure  of  the  successive  images. 
Given  the  variation  in  projected  image  size  based  on ^distance, 
apparently  size  is  not  important.     The  version  under  development 
will  retain  the  one  second  exposure  time  used  in  the  film 
version.     Scoring  will   be  done  by  the  program. 

Cgncl^usign  .  ^ 

Microcomputers  seem  to  be  capable  of  administering  many  of  ^ 
the  commonly  used  cognitive  style  measurement  instruments.  They 
are  dependable  aild     can  increase  reliability  through  increased 
precision  and  accuracy.      It  is  economical   to  use  microcomputers 
for  test  administration.     While  some  tests,  such  as  Ihe_Leyel i ng^ 
Sharaenina-Hoyse^Iest  may  sti^ll   need  a  trained  observer,  many 
others  such  as  Ihe_GrguB-ifDk§dded_Figure5_Iest  and  -  Ihe^Successi ye 
I{DE»:§ssieQs«I§5t_I  relieve  the  need  f^XDr  close  supervision.  All 
three  maintain  or  increase  test  reliability.     These  factors  and 
the  ease  af  gathering  data  should  help  encourage  further  research 
in  the  use  of  cogni t i ve  styl es  for  the  individualization  of 
instruction-     They  will  surely  assist  in  the  delivery  of  that  . 
instruction. 
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• '  ABSTRACT  c 

I 

c  . 
The  present  study  investigated  the,. research  construct  of 

encodings  specif icity  using  an  applied  research  orientation. 

Encoding  specificity  considers  the  effects  on  memory  of  the 

interactive  relationship  among  encoding,  the  stored  memory  trace, 

and  external  retrieval  cues.     The  present  experiment  used  typical 

classroom  presentation^ methods  and  testing  methods  to  Investigate 

the  encoding  specificity  hypoth^is.     Two  types  of  instructional  ' 

presentations  were  given,  one  visualized  and  one  verbalized. 

Three  types  of  testing  measures  wero  used  to  test  factual 

learning,  each  providing  different  types  of  external  retrieval 

cues;  free  recall;  verbally  cued-recall,  and  visually  cued-recall 

A  complex  relationship  existed  between  type  of  instruction  and 

type  of  external  cue  provided  during  testing,  essentially 

supporting  the  encoding  specificity  hypothesis.  . 
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Problem  and  Rationale 

The  psychological  research  construct  or  oacoding  specificity 
addresses  an  important  orientation  for  educational  technologists 
involved  with  research  on  learning  and  instructional  development 
activities.     In  the  encoding  specificity  orientation,  the  ability 
to  recall  learned  information  is  a  direct . function  of  the 
relationship  which  exists  among  encoding  [information 
input/learning],  the  stored  memory  trace  [cognitive  information], 
and  the  external  retrieval  cue.     In  this  respect,  encoding 
specificity  research  conclvies  that  it  is  possible  for 
information  to  be  available  in  the  -ognitive  structure,  and 
therefore  to  have  been  learned;  however,  for  retrieval  purposes 
this  information  may  be  inaccessible  because  the  appropriate 
external  retrieval  cues  may  not.be  available  in  the  testing 
environment. 

The  importance  of  the  encoding  specificity  construct  for 
educational  technologists  is  revealed  by  the  fact  'that  a  number 
of  research  studies  have  found  that  significant  interactions 
exist  among  encoding,  memory  trace,  and  external  retrieval  cues. 
The  practical  significance  inherent  in  ^e  encoding  specificity 
construct  implies  that  if  a  mismatch  exists  between  how  ; 
instructional  content  was  originally  presented  to  students  and 
hov  it  was  subsequently  evaluated  -  in  terms  of  having  the  ^ 
appropriate  retrieval  cues  available  in  the  evaluation  mode  - 
students  will,  not  be  able  to  utilize  fully  information  previously 
acc  ired. 
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Although  a  number  of  empirical  studies  have,  been  -nducted 
on  the  encoding  specificity  construct,  little  applied  re  .^.arch  is 
currently  available.     Most  of  this  research  has  focused  on  t . '  "^s 
of  learning  and  experimental  conditions  ^ar  removed  from  wh£^ 
might  be  expected  to  be  found---n-a  typict .  classroom  envire  ;^ . 
While  these  research  findings  are  valuable,    .  uiy  make 
generalization  to  specific  classroom  instruc.  o-sl  environments 
difficult.     The  present  study  purports  to  ac;5.rei:-s  this  problem  by 
using  typical  classroom  instructional  materials,  ?.cademic 
content,  and  environment,  within  the  context  of  aa  encoding 
specificity  study.     The  majority  of  past  research  in  the  encoding 
specificity  area  has  used  various  forms  of  paired-associate 
learning  tasks  presented  to  individual  subjects,  representing  - 
essentially  a  laboratory  situation,   (Tulving,  1979). 

The  learning  condit'oas  in  the  present  gtudy  use  a 
slide-tape  instructional  .'presentation,  typical  of  an  audiovisual 
segment  during  a  class  session.     The  exp&r icantal  conditions  were 
conducted  in  a  classroom  setting  with  groups  of  40  subjects.  Of 
course  the  subjects  were  aware  that  they  were  involved  in  an 
educatipnal  study,  but  they  were  told  that  the  content  taey  were 
to  learn  was  a  typical  college  type  of  academic  content  in 
physiology.    Additionally,  they  were  told  that  the  presentation 
method  was  a  slide-tape  audiovisual  presentation,  similar  to  what 
would  be.  seen  as  part  of  a  class  session.     They  were  also  vr  ^ 
that  they  would  be  required  to  remember  information  presented  in 
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the  audiovisual  program,  similar  to  vhat  would  be  done  during  an 
audiovisual  classroom  segment.     While  the  subjects  knev;  they  were 
involved  in  an  experiment  in  learning,  the  present  studies' 
conditions  emulated  a  classroom  situation  far  beyond  mpst  of  the 
past  research  with  the  encoding  "spec.i  fi  city  construct. 

Furthermore,  the  slide-tape  content  piesents  the  learner 
with  an  instructional  program  which  describes  the  names  of  the 
parts  and  functions  of  the  human  heart.     Again  this  content:  is  . 
typical  of  what  would  be  found  at  the  college  level  in  a  bio3 ogy  , 
class  audiovisual  segment  to  complement  a  lecture;  The 
slide-tape  instructional  materials  employed  in  the  study  were  an 
adaptation  of  the  Dwyer  U967,  1978)  instructional  treatment 
materials.     These  materials  were  used  because  they  closely 
resemble  audiovisual  instructional  presentations  rsed  in  the 
classroom  and  have  been  validated  in  a  large  liSaTiber  of  studies 
investigating  a  variety  of  instructional  and  learning  bvpothesis 
(Dwyer,  1982) . 

Related  Encoding  Specificity  Research 

The  crux  of  the  encoding  specificity  research  orientation,  is 
involved  with  the  interactive." relationship  which  exists  among  th^i 
encoding  phases,  the  memory  trace,'  retrieval  cues,  and  sub,S3C uent 
effects  upon  the  learner's  skill  performance.     Basic  research  on 
encoding  specificity,  from  a' psyGhological  research  paradigm, 
suggests  that  encoding  specificity  is  not  a  superficial 
phenomenon,  but  is  rather  a  psychological  principle.  Tulving 
(1^;79,  p. -417)  in  reviewing  the  related  litsrature  in  this' area 
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has  concluded  that  "...  over  a  considerable  range  of  experimental 
conditions,  empirical  facts  show  that  remembering  of  events  is 
determined  by  the  interaction  between  encoding. and  retrieval." 
Siinilarlyf  in  an  early  study,  Tulving  and  Osier  (1968),found  a 
direct  relationship  between  encoding  and  retrieval.     Using  a 
uaired-associate  learning  paradigm,  they  had  two  encoding 
conditions  and  two  retrieval  conditions .     The  two  encoding 
conditions  were;   (1)  a  target  word  plus  cue  A,  and  (2)  a  target 
word  plus  cue  B.     The  two  retrieval  conditions  were;   (1)  present 
retrieval  cue  A,  and  (2)  present  retrieval  cue  B.     The  experiment 
resulted  in  the  following  strong  interaction  as  revealed  by 
percent  of  correct  recalled  target  words. 


(Encoding  Cue) 


(Retrieval  Cue) 
A  ^  B 


A 
B 


62% 
33% 


29% 
62% 


From  these  results  Tulving  and  Osier  concluded  that  successful 

■  -a  ■    .-.  ■ 

retrieval  of  information  stored  in  the  cognitive  structure  is 
contingent  upon  the  appropriate-  external  cue  to  match  the  stored 
memory  traces.     It  should  also  be  noted  that  this  early  study 
represents  the  typical  pncoding  specificity  experimental  setting, 
using  paired-associates,  administered  to  individual  subjects. 
This  type  of  highly  experimental  setting  is  quite  removed  .fr 9m 


ERIC 


78 


8d 


typical  classroom  instructional  environments.     Additicnally ,  note 
that  the  retrieval  cues  are  similar,  stemming  from  the  encoding 
contexts,  but  represent . different  cues  to  access  different  memory 
traces.     This  difference  in  cues  should  not  be  interpreted  as  cue 
inconipatibility,  but  simply  as  different  cueing  types. 

\ 

In  a  later  experiment  by  Thomson  and  Tulving  (1970),  similar 
results  occurred,  indicating  a  strong  significant  relationship 
between  encoding  and  retrieval  cue.     This  experiment  used  a 
paired-associate  learning  task  and  sfeveral  types  of  cue 
conditions.     Frpm  their  results,  Thomson  and  Tulving  (1970,  p. 
261)   concluded  that  "retrievar^^^ of  event  information  can  only  be 
effected  by  retrieval  cues  corxesponding  to  a  part  of  the  total 
vencoding  pattern  representing  the  perceptual  registration  of  the 
occurrence  of  the  event."     In  this  respect  the  original  encoding 
specificity  hypothesis  can  be  interpreted  to  indicate  that 
retrieval  is  facilitated  if  external  retrieval  cues  match  a  part 
of  what  was  stored  during  learning. 

The  majority  of  the  encoding  specificity  research  h.;  s  used 

experimental  designs  that  directly  relate  to  the  memory  elements 

of  encoding,  the  memory  trace,  retrieval  cues,  and  the 

interaction  of  these  memory  elements,   (Anderson,  Pichart,  Goetz, 

Schallert,  Stevens,  and  Trollip,  1976;  Tulving  and  Watkins,  1975; 

Moscovitch  and  Craik,  1976).       jsults  of  these  experiments 

generally  confirm  the  encoding  specificity  hypothesis.  However, 

there  is  the  counter  argument  that  is  offered  by  the  levels^. of 

* 

processing,  research  orientation..    Craik  and  Lockhart  (1972,  p. 
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645)  contend  that  "trace  persistence  is  a  function  of  depth  of 
analysis,  with  deeper  levels  of  analysis  associated  with  more 
elaborate,  longer  lasting,  and  stronger  traces."     In  line  with 
the  levels  of  processing  conclusions,  memory  research  further, 
indicates  that  orienting  tasks  which  tend  to  cause  deeper  more 
elaborate  memory  traces  do  improve  recall  of  learned  information, 
(Hyde  and  Jenkins,  1969;  1973).     Such  orienting  tasks  could  be 
directions  to  form  images,  advance  organizers,  or  specific  . 
acquired  mnemonic  strategies.     Craik  and  Tulving  (1975)  found 
that  free  recall  and  recognition  varied  considerably,  contingent 
upon  the  type  of  orienting  tasks,  or  memory  instructions,  giv^n 
prior  to  learning.  .  . 

'  However,  while  the  levels  of  processing  orientation^appears 

viable,   in  explaining  psychological  factors  related  to  recall  and 
the  recognition  of  stored  information,  the  levels  of  processing 
orientation  provides  only  i)art  of  the  explanation.     Recall  and 
recognition  memory  are  probably  effected  by  orienting  tasks 
altering  processing  level,  but  the  relationship  between  the 

" stored  memory  trace  and  external  retrieval  cues  is  a  strong 
variable  determining  the  success  of  memory  operations.     In  a 
series  of  experiments  investigating  the  levels  of  processing 
hypothesis.  Fisher  and  Craik  (1977,  p.  709)  concluded  that  "... 
the  retention  levels  associated  with  a  particular  type  of 
encoding  were  not  fixed,  but  depended  heavily  on  the  type  of 
retrieval  cue  used."     This  conclusion  may  be  interpreted  to 
indicate  that  external  retrieval  cues  will  have  a  significant 
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relationship  to  learned  inf ormation^.  in  terms  of  imjprovi ng  or 
debilitating  recall  and  recognition.  *  • 

One  generalization  which  may  be  derived  from  past  research 
on  encoding  specificity  is  that  a  significant  relationship  exists 
among  encoding ,  the  stored  memory  trace,  and  the  external 
retrieval  cue'.'  .  Additionally/  the  compatibility  of  these  three 
memory  elements  will  have  significant  effects  upon  the  learner's 
ability  to  apply  stored  information  during  the  testing  situation. 
The  problem  with  much  of  the  "past  research  in  this  area,  however, 
is  that  learning  tasks,  learning  materials,  and  presentation 
methods,  employed  in  the  experimental  context,  are  too  removed 
from  typical  instructional  methods  and  cla'ssroom  settings.  This, 
situation  makes  it  difficult  to  apply  these  significant  research 
results  to  the  task  of  designing  appropriate  evaluation  and 
testing  methods,  that  match  instruction  in  terms  of  the  basic 
memory  elements  of  encoding,  memory  trace,  and  retrieval  cues. 
The  present  study  attempts  to  evaluate  the  encoding  specificity 
orientation  within  "the  context  of  an  applied  learning 
situation.  ' 

j 

Experimental  Design  and  Procedures  .    ^  i 

This  study  employed  a  2x3  analysis  ofS^variance  design 
utilizing  two  between-sub jects  variables.     The  first  j 
between-subjects  variable  was  the  type  of  instruction  presented. 
The  two  levels  of  the  instructional  variable  were  the  visualized 
mediated  instruction  (VISU)  and  the  verbally  mediated /instructio;i 
(VERB).     The  type  of  content  included  in  each  instructional  ^-^^ 
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was  representative  of  the  kind  of  academic  content  typically 
presented  in  teaching-learning  situations.     The  instructional 
unit  was  designed  to  instruct  learners  on  the  names  of  the  parts 
and  processes  of  the  human  heart.     The  instructional  units  were 
presented  in  the  fofm  of  slide-tape  presentations  lasting  22 
minutes.     Both  slide-tape ^programs  used  the  same  pulse 
synchronized  audio  tape.i  so  the  to-be-learned  instructional 
content  in  both  units  was  identical.     The  difference  between  the 
VISU  and  VERB  instructional  presentation  was  in  the  slide  portion 
of  the  presentations.     Both  groups  saw  the  same  number  of  slides 
in  the  same  sequence.     The  VISU  gfoup  saw  a  color  illustration 
slide  set  with  a  verbal  label  identifying  the  relevant  heart,  part 

7  "   :  .  

on  each  slide,  and  an  arrow  pointing  to  the  part.     Each  slide  was 

an  artist  drawn  illustration  of  a  dissected  heart,  similar  to 

what  would  be  found  ,in  a  textbook.     The  VERB  group  saw  a  set  of 

verbal  label  slides,  which  consisted  of  a  verbal  label  that  named 

the  heart  part  described  on  the  audio  tape.     the  VERB  slide  set/ 

presented  the  same  verbal  labels  that  appeared  on  the  VISU  slide 

set, .but  did  not  contain  an 'artist  illustration.     The  VERB  slide. 

set  contained  verbally  mediated  instructional  content,  supported 
♦ 

by  the  audio  tape  program.' 

?  -     '  ^  ■-. 

Tjhe  second  between-sub jects  variable  was  the  type  of  cueing 

measure,  used  during  testing.  This  variable  sfer.ves  as  the  key  to 

the  encoding  specificity  hypothesis  in  the  context' of  this 

"experiment.     Three  measures  of  the  cueing  variable  were  employed 

(free  recall,  visually , cued-recall ,  verbally  cued-recall) .  These" 

.   .  82 
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three  measures' were  designed  to  test  the  learners'  ability  to 
acquire  from  the  slide-tape  instructional  programs  the  names  of 
the  parts  of  the  heart  and  the  heart  phase  names.     There  were  19 
part  names  and  2  phase  names  to  be  learned  from  the  instructional 
programs,  producing  a  total  of  21.  possible  points  on  each  measure. 
All  three  measures  tested  the  same  intellectual  skill,  in  this 
case  the  factual  learning  of  21  part  and- phase  names.  Both 
instructional  units /pr-ovided  the  leafrner  with  the  same  target 
inforrtjation  to  accomplish  the.  specif  ied  learning  task.^  However, 
the  difference  in  ^ach'  of  the  measures  was  in  the  type  of 
external  retrieval > cue  provided  to  the  learner  during  testing. 
The  measures  represent  diff^flrent  cues  designed  to  assess  the  same 
encoded  target  information,  the  21  part  and  phase  names  assumed 
to  be  stored  as  a  jf unction  of  interacting  with  the  heart 
slide-tape  dnstrucltional  programs.     Poth  the  visually  cued-recall 
measure  and  verbal[ly  cued-recall  measure  were  derived  from  the 
original  instructijoEial  program  consent,  so  they  were  compatible, 
'  but  represent  diffjerent  cues  to  assess  the  stored  memory 


traces, , 


The  free  reca 
parts 'of  the  hekrt 
any  order.     The  vi 


11  measure  required  the  subject  to  list  the  19 

and  .the  2  heart  phase  names  from  memory ,  in  / 
sually  cued-recall  measure  required  the  subje<t:t 
to ' write  down  ^be  correct  part  name  when  he  saw  that  part  J 
identified  by  an  ^r,row  on  an  illustration  slide.     To  accomplish 
'this,  subjects  savi  .the -illustration  slides  of  the  heart,  ^ 
describing  the  parts  and ''phases,  with  the  verbal  labels  reitfgved 

o        ...     "  ■    ;    /  an 


Each  slide  had  an  arrow,  however,  pointing  to  the  part  in 
question,  and  subjects  were  instructed  to  write  down  the  part 
name.     The  slides  used  were  from  the  VISU  instructional  program 
and  were  the  slides  naming  the  parts  and  phases,  however,  the 
slides  were  altered  by  removingi  the  verbal  labels. 

,    •  \  .  .  '" 

The  verbally  cued--recall  measure  provided  the  subject  with>a 

verbal  cue  of ^ the  part  name  or  phase  name  in  question.  To 

j  ■'/ 

accomplish  tWis  subjects  saw  a  set  of  verbal  cue  slides.  This 

f.  I 

set  pf  slidej^  consisted  of  21  slides,  each  containing  a  verbal 
cue  relevant  to  a  particular  part  or  name.     The  verbal  cue  on 

each  slide  consisted  of  the  first  three  letters  of  the  part  name 

/ 

the  subject  was  to  recall.     For  example,  the  cue  for  myocardium, 
was  MYO.     For  heart  part  names  that  distinguished  between 
arteries,  veins -or  valves,   (i.e.^  Pulmonary  Artery  vs.  Pulmonary 
Valve),  the  cue  AR,  VE,  or  VA  was  given  next  to  the  three  letter 
cue.     Additionally,  for  a  part  that  was  distinguished  as  Right  or 
Left,  the  cue  R /or  L  was  added  to  the  three  letter  cue.  Subjects 
were  instructed^  to  wrirte  down  the  complete  name  of  the  part  or 

phase  when  they  saw  the  cue  slide. 

/  0 

A  total  pf  273  undergraduate  level  students  enrolled  in  the 
College  of  Engineering  at  The  Pennsylvania  State  University 
constituted  the  population  for  this  study.     All  subjects  took  a 
pretest  on  physiology  to  uetermine  their  level  of  prior  knowledge 
in  general  physiology.     Of  the  273  subjects,  31  were  identified 
as  having  significant  knowledge  in  physiology  by  scoring  above 
59%  on  the  physiology  pretest.     They  participated  in  the  study 

84 


I 


ERIC 


but  all  their  data  was  eliminated  from  the  final  data  pool.o 
Additionally r  two  other  subjects  V  data  were  randomly  eliminated 
from  the  study  to  provide  an  equal  number  of  subjects  in  each 
cell  of  the  analysis  of  variance.  Data  was  calculated  using  a 
total  of  240  subjects^  with  exactly  40  subjects  in  each  of  the 
six  cells  of  the' analysis  of  variance. 

Subjects  were  randomly  distributed  to  the  instructional 
treatments  of  visualized  mediated  instruction^  and  verbalized 
mediated  instruction.     There  were  120  subjects  in  each  of  the  two 
instructional  treatment  groups  from  which  data  was  collected. 
From  within  each  instructional  tr^atmi§B4;,  group^  subjects  were 
randomly  distributed  to  each  of  the  cueing  measures^  making  up 
the  testing^conditions  of  free  recall^  visually  cued-reSallf 
verbally  cued-recall.  1 

Instructional  treatments  and  testing  conditions  were 
administered  to  each  cell  in  the  experimental  design  separately. 
There  were  six  groups  of  subjects ^  making  up  the  six  cells  of  the 
experimental  design.     The  six  cells  were: 

1)  VISU  instruction  +  Free  recall/ 

2)  .     VISU  instruction  4-  Visually  cued-recall , 

3)  VISU  instruction  +  Verbally  cued-recall r 

4)  VERB  instruction  +  Free  recall/ 

5)  VERB  instruction  +  Visually  cued-recall/ 

6)  VERB  instruction  +  Verbally  cued-recall. 
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The  six  sessions  of  instructional  treatments  and  testing 
conditions,  were  administered  during  a  six  hour  block  of  time  on 
one  day.     Each  session  started  on  the  hour,  subjects  were  given 
45  minutes  to  view  the  instructional  treatment  and  take. their 
particular  test.     Subjects  were  told  prior  to  the  instructional 
treatment  that  they  would  see  a  slide-tape  instructional  program 
on  thr:  human  heart.     They  were  told  that  the  slide-tape  program 
represe-  ted  a  typical  audiovisual  program  used  to  complement  a 
class  session.     They  were  also  told  to  try  and  remember  basic 
facts  from  the  slide-tape  instructional  setting..  Finally, 
subjects  were  advised  to  interact  with  the  instructional  program 
in  the  same  way  they  would  with  an  audiovisual  program  presented 
during  a  class  session. 


Immediately  after  the  slide-tape  program  about  „the  heart,  - 
subjects  were  given  their  respective  testing  cbndition.  They 
were  given  instructions  on  how  to  respond  to  their  particular 
test,  contingent  upon  their  type  of  testing  condition.     After  the 
subjects  completed  their  test,  they  were  given  instructions  not 
to  tell  their  friends  what  the  slide-tape  program  was  about  and 
what  their  test  was  like.     They  were  then  told  that  the 
experiment  investigated  memory  skills,  and  that  prior  knowledge 
about  the  instruction  and  the  testing,  would  give  their  friends 
an  advantage  and  contaminate  the  data.     The  same  procedures  and 
instructions  were  carried  out  in  all  six  sessions. 
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Results  and  Discussions 

The  raw  data  was  analyzed  using  a  2x3  analysis  of  variance, 
yielding  the  following  resulting  analysis  of  variance  sumiaary 
table  (Table  1).        ,  .  . 


BETWEEN  SUBJECTS 

Source 

Mean  Squares 

Df 

F-ratio 

Probabi_lity 

Instruction  (A) 

484.504 

1 

41.030 

.0001 

Cue  Measure  (B) 

734.629 

2 

' 62:211 

.0001 

(A)   X  (B) 

240.754 

2 

20.388 

.0001 

Error 

11.809 

234 

Table  1:     Resulting  Analysis  of 
'  Variance  Summary  Table 

Statistically  significant  results  occurred  in  the  instructional 
variable  and  in  the  cueing  measure  variable.     Additionally/  a 
statistically  significant  interaction  occurred  between  the 
instructional  variable  and  the  cueing  measure  variable. 

The  significant  results  on  the  instructional  variable, 
[F(l,234,df )  =  41.030,  p  =  .0001]  indicated  that  the  visualized 
mediated  instruction  mean  (X  =  13.175)  was  superior  to 
the  verbalized  mediated  instruction  mean  (X  =  10.333). 
This  finding  is  generally  consistent  with  prior  research  (Dwyr.r, 
1978)  which  contends  that  when  visualization  is  properly  designed 
and  integrated  into  an  instructional  sequence,  increases  in 
student  performance  are  likely  to  occur. 
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Significant  results  on  the  cueing  measure  variable 
[F(2,234,df)  =  62.211,  p  =  .0001]  yielded  statistical  difference 
between  the  types  of  cueing  measures.     A  Tukey  test  set  at  (.01) 
•ilpha  indicated  that  the  verbally  cued-recall  measure 
(K  =  15.24)  differed  Significantly  from  the  free 
recall  measure  (X  =  9.73),  and  the  visually 
cued-recall  measure  (X  =  10.30).     In  this  analysis  the 
free  recall  measure  (X  =  9,73)  did  not  differ  from  the  / 
visually  cued-recall  measure  (X  =  10.30).     At  first 
glance  the  lack  of  significant  differences  between  the  free 
recall  and  the  visually  cued-recall  measures  may  appear 
surprising^  since  a  cued-recall  measure  should  aid  memory. 
However^  note  that  a  significant  interaction  occurred.  This 
interaction  affected  the  visually  cued-recall  overall  mean  score. 
So  when  the  visually  cued-recall  mean  score  was  averaged  across 
the  VISU  and  VERB  instructional  variable^  any  mathematical 
differences  between  free  recall  and  visually  cued-recall  were 
cancelled.     However,  looking  at  yable  2,  it  can  be  seen  that 
statistically  significant  differences  occurred  between  the  free 
recall  mean  (X  =  10.55)  and  the  visually  cued-recall 
mean  (X=  13.68),  at 'the  VISU  instructional  variable 
level,   (Tukey  test  at  .01  significance  level).     Additionally,  no 
statistically  significant  .differences  occurred  between  the 
visually  cued-recall  cell  and  the  verbally  cued-recall  cell  at  - 
the  .01  level  of  significance  using  a  Tukey  test.     This  re&ult 
can  be  interpreted  to  indicate  that  cued-recall  aids  learning 
over,  free  recall. 
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However y  the  encodingj, specif  -^iory  would  have 

predicted  that  given  the  VISU  instru  \  condition^  the  _ 

verbally  cued-recall  test  should  have  i    -    significantly  lower 
than  visually  cued-recall  testing^  not  statistically  equal.  This 
can  be  explained  by  the  fact  that  durino  VISU  instruction  the 
subject  perceived  a  visual  illustratior    >nd  a  verbal  label..  From 
this  learning  condition  it  can  be  assumed  that  a  dual  code, 
visual  and  verbal r  must  have  then  been  stored  since  both  visfcial^ 
cues  and  verbal  cues. allowed  effective  recall.     In  a  hypothetical 
sense  this  supports  the  encoding  specif icity  theory ^  since  both 
visual  and  verbal  cues  related  t'o  the  assumed  to^be  stored  visual 
and  verbal  encoding  contexts,     ^t  is  likely  that  a  complete 
cross-over  interaction  could  o'^cur  by  eliminating  the  verbal 
labels  from  the  slides  in  the  VISU  instciictional  condition.  If 
this  were  doner  subjects  could  acquire  the  target  information^ 
the  part  and  phase  names r  from  the  audio  portion  of  the 
slide-tape,  instructional  program.  ^  , 

The  analysis  indicated  a  significant  interaction  existed 
between  the  instructional  variable  and  the  cueing  measure 
variably  [F,(2,234,df)  =  20.388,  p  =  .i)06l].     A  Tukey  test  set  at 
.01  alpha  was  used  to  indicate  the  source  of  the  interaction. 
The  individual  cell  means  appear  in  Table  2  and  the  resulting 
disordinal  interaction  is  illustrated        Figure  1. 
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l?able  2:     Individual  Cell  Means. 
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Figure  1:     Disordinal  iaterkction. 

91 


,  toz 


liOoking  at  the  cell  means  the  Tukey  test  (alpha 
.01  Vindicated  that  the  free  recall  means  did  not  differ 
significantly  at  each  of  the  two  levels  of  the  instructional 
variable,  VISU  and  VERB.     Similarly ,  the  verbally  cued-recall 

means  did  not  differ  s.lqnificantly  at  each  of  the^levels  of  the 

.  ^  ^ 

instructi9nal  variable.     The  source  of  the  interaction-^was  found 
to  be  with  the  vis\ially  cued-recall  measure.     As  can  be  seen  in 
Table  2,  the  visually  cued-recall  means  differed  significantly 
across  the  VISU  and  VERB  instructional"  variable  levels.  The 
visually  cued-recall ^measure  was  not  ^effective  for  subjects 
receiving  Verbalized. instruction^     However^  for  subjects 
receiving  visualized  instruction  the  visually  cued-recall  measure 
was  effective. 

The  resulting  interact;ion  "finds  support  for  the  encoding 
specificity  hypothesis,  indicating  a 'significant  relationship 
between  encoding,  the  memory  trace,  and  the  external  retrieval 
cue.     Both  ^he  VISU  and  VERB  instructional  -cdnditions  provided 
subjects  with  the  names  of  the  parts  of  the  heart  and  the  heart 
phase  names'.     Howfever,  the  two  instructional  conditions  provided 
this  essential  to-be-learned  information  in  a  completely 
different  encoding  pattern.     The ^ VISU  instructional  condition 
provided  subjects  with  the  heart  part  and  phase  names  m  a  visual 
context  allowing  storage  of  a  visual- and  verbal  memory  trace. 
The  VERfi  condition  provided  th^  part  and  phase  information  in  a 
verbal  context  allowing ^storage  of  a  verbal  trace  only.  The 
external  retrieval,  cue  of  visua:i.ly  cued-recall  was  compatible 
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with  the  visual  memory  plus  verbal  memory  trace  assumed  to  be  . 
stored  as  a  result  of  the  VISU  instruc4f!ional  csonditiorir .  but 
incompatible  with  th^  vferbal  only  memory  trace  given  in  the  VERB, 
instructional  condition.     Even  though  both  instructional 
presentations  allowed  the  subjects  to  store  the  relevant  ' 
to-be-learned  inf  ormation,  >  they  ^coul(^  not  recall  the  correct 
inf  ormation  if  incompatability' exist{ed  between  external  retrieval 

cues  in  the. test  and  information  stQred  in  the  cognitive 

**  . .  * 

structure..  •  • 

,  "J  ",.*■*• 

In  ,the  case  df  the  visually  cued-recall  test  for  learners 
i^eceiving  verbal  "instruction,  the  resulting  student  performance  ' 
was  found  not  to  be  a  function  of  what  intellectual  skills  were 
learned  from  the  .instruction^  but  rather  a  function  of  the 
.  compatibility  between  trie  external  retrieval  cue  and  th,e  stored 
memory  trace.     Even  thoiigh  the  learner  had  acquired  the 
intellectual  skill  of  factual  learning,  the  form  of  the  ttesting 

condition  caused  the  difference  in  performance,  not  the  actual 

^.  . 

learned  intellectual  ability.     The  practical  implications  of  this 

.  i* 

result  relate  directly  to  the  development  of  instruction  and 
testing  conditions^  existing  in  the'' typical  learning  environment. 
If  visual  information  is  presented  in  the  instruction,  or  is  a 
critical  comporient  of  instruction,  visual  cues  should  be  pjovided^ 
for  in  the  testing  conditipn.     For  example  if  the  learner., 
receives  a  demonstration"  of  ah  engineering  laboratory-  experiment, 
using  an  apparatus  to  be  set  up  and  correctly  employea ,  the 
testing  situation  should  not  be  completely  verbal.  ..In  this  ^ 
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o  exainple  the  learner  may  have- acquired  the  psychomotor  and 

.   intellectual  skill  but  the  correct  cues  to  allow,  performance  may 
not  be  on  the  test.     In  training  situations  equipment  operatioh^ 
and  specific  procedures  are  bften  taught  via  visualized.  - 
instruction,  but  tests  tend  to  be  mostly  veirbalv    It  is  likely 
that  the  learner, may  have  acqurred  the  skill  but  cannot  perform  ' 
satisfactorily  because  of  the  incompatibility  between  the  learned 
information  and  retrieval' cues  providedron  t'ne  test.  Traditional 

'    verbal  tests  may  be  appropriate  f  or  verbal  only  .instructional 
methods-.but  if  visuals  are  a/^ignificant  part^of  the  instruction 
and  the  learned  skill,  t^ere  should  be -visual  cues  on- the  test. 
These  visual  cues  should  relate  directly  to  what  is  assumed  to  be 
stored  in  the  learner's  cognitive  structure  and.be  congruent  in 
-format.     Presently , /in  mos't  classroom  testing  situations,  there 

.    exists  a  mismatch  between  the .encoding  context  of  instructional 
information  and  cues  provided  extefnally  during  .testing.     It  is 
likely  that  in  such  a  situation  the  intellectual  skills  may .have 
been  acquired,  but  pferformance  failure  may  occur  as  a  function  of 
the'^extenal  cue  and  memory  trace  mismatch. 

■  •  •  ■  ■      ^  ^      ^  ^ 

The  results  of  .this  study  indicate  that  there  is,  a 

significant  .relationshiE<  existing  among -encodi^ng,  the  stored 

.    menfoi;y  4:race ,  and  retrieval  cues.     Furthermore  this  significant 

rel'ationship  applies /-to  the  classroom  teaching-learning-testing  - 

•  environment,  since  within  the  context  of  a  classroom  learning 

"  situat,ion  the  fencoding  specificity  hypothesis  -was  able  to  be 

^supported.     This"  relationship  has  significant  implications  not 
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only  for  the, development  of  instruction  and  testing,  but  for  - 
subsequent  research  endeavors  in  the  areas  of  visual  learning  dnd 
the  improvement  of  instr4ictib;gL.4nd  evaluation  procedures.  Future 
applied  research  in  the  area  of  encoding  specificity  might  find 
it  fruitf^ul  to  consider  the  relationship  that  exists  among, 
encodi-ng,  memory  trace,  arid  external  retrieval  cues  when  content 
presentation  and  evaluati'on  strategies  are  systemat^ically  varied, 
and  where  s^tudent  intellectual  .performance  at  different  learning 

/        ■  ;  ;  3        .  .  ,  ^       .  ■  •-■ 

levels  is  considered  as  the  dependent  variable.    -     .     ^  ^  / 
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ADMINISTRATORS* PERCEPTIONS   OF  COMPUTER  USAGE   IN  EDUCATION 
PURPOSE 

With   the  advent   of   the  microcoinputer ,   edu'^cators  are  develop- 
ing  ah  increased   interest   in  the  possibility  of   using  this  tech- 
nology in  the   formal  educational   setting.     There  is  a  special 
interest   in   its  application   for  kindergarten  through  twelth  grade 
schooling.     While   there   is  a  great   deal   of   discussion  relating  to 
this  possibility,   relatively  little  data  are  available  regarding, 
the  attitudes   that   school  principals  have  toward   the  use  of  this 
educational  medium  in  the  classroom.     Since  principals  are  the 
chief  administrative  officers  at   the   school  level,   their  attitudes 

toward   any   learning  approach  are   instrumental   in  guiding  the 

%      ■  . 

adoption  or   rejection  of   the  use   of   computers  vithin  their  spere 
of   control.      For   this  reason,   it  'is   important '  that   the  views  of 
these  decision  makers  be  studied  and   taken   into  considerat ion.  when 
looking  at    the  potential  of  computers   in  education. 

Research  Questions 

-   This   study  concentrates  upon   those  attitudes  which  the 
educational   leade.rs  hold.      In  part  icular  ^,   the   subtopics  studied 
were  : 

•    A.      In   the  opinion  of  principals,  what  would  be  the 
probable   student   response   to   computers   in  the  classroom? 

■B.      In   the  opinion  of  principals.,  what  would  be  the 
probable   teacher   response  to   computers   in  the  classrooni? 
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C.  r  In  the  opinion  of  principals,   what   is   the  current 

fi 

level  of  computer  literacy  among  their   school  teachers. 

D.  In  the  opinion  of  principals,   will  the   effect  of  ^. 
computers  in  education  be  positive  or*  negative. 

E.  In  the  opinion  of  principals,  which  factors  are  the 
.most   impdrtant   in   the   future  purchase  of  computer  equipment? 

F.  In  ^he  opinion  of  principals,   how  are  computers 
presently  used   in  the  classroom? 

G.  Are   schools   in   large   school  district s  more  or  less 
likely  to  have  computers   than  schools   in  medium  or\  small  school 
districts?  \ 

PROCEDURE 

In  October  of   1982,   a   survey  questionnaire  was  maVled  to 
principals  of   10%  of   the  K-12   schools   in  Arkansas.     The  schools 
were   selected  randomly  from  three   size  school  districts:  small, 
medium,   and  large.      The  response  rate   to   the  questionnaire  were 
equivalent  among   these   groups.      Sixty-four  percent  of  the 
institutions  surveyed  returned  the  questionnaire      (76  "respondents) 

RESULTS 

During  the   following  discussion  of  the  results,   the  reader 
may  refer  to  the   survey  quest ionnaire   included  .at   the  end  of  this 
'  report . 

Principals   in  kindergarten  through   twelfth  grade  schools  were 
asked  to  rate   the  probable   student   interest   in  using  computers  in 
the  classroom.      (Question  #19  on  the   survey) .     The  data  indicated 
most  of  the  stud,ents  would  welcome   the   computer  as  a  part  of  their 
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education;    Sixteen  of  the.      .pond Ing  pr ln= ip.l.  f.lt   th,t  91-100% 

of  the  students  would  have  a  very  favorable  attitude  toward  the 

use  of  computers  In' tL  olassrooe.  .  As  chart   1  shows,   the  principals 

V  ,  -I  J  ii'ft-ie   student  opposition  to  the 

believed  that   there  would  be   little, stuue 

introduction,  of   the  computer.    


Responses 


Percent  of 
Students 

Very 

Favorable 

Favorable 

Neutral 

Unfavorable 

Very 

Unfavorable 

1-10% 

2 

11 

23 

Id 

« 

11-20% 

2 

9 

6 

2 

0 

21-30% 

6 

11  , 

5 

1 

0 

31-40% 

3 

3 

3 

0 

0 

41-50% 

.6 

5 

1 

0  . 

0 

51-60% 

2 

2 

0 

0 

6 

61-70% 

4 

1 

f 

0 

0 

71-80% 

12  • 

0 

0 

0 

81-90% 

7 

0 

0 

0 

0 

91-100% 

16 

8  ' 

0 

0 

0 

Table  1. 


Principals  perceptions  of  student  response  to  the  use  of  computers 
in  the  classroom 


The   results  of  probable   student   interest  were  not  particu- 
larly  surprising.     However,    the  question  which  dealt  with  the 
probable   teacher  response   to   using  computers   in  the  classroom 
yielded  an  unexpected  response.      (Question   20  on  the  survey). 
The   principals'    responses   suggested  that,   the  .great  majority  of 
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educators   in   their   schools  would  also   support   the  u^ie  of   computer  < 
technology/    I?n  table   2,   note  that   the  attitude  trends  toward  the 
use  of   computers   in  the   classroom  is   quite   similar  between  students 
and   t  eacher.s  . 

  *     "  . 

•  ^  <^ 

■  Responses 


Percent  of 
students 

Very 

Favorable 

Favorable 

Neutral 

Unfavorable 

Very 
■  Unfavora 

1-10% 

4 

1*1 

23 

16 

9 

11-20% 

4 

9  ,. 

6 

2 

0 

21-30% 

6 

11 

5 

1 

0 

31-40% 

'1 

3  - 

3 

0 

0 

41-50% 

7 

5 

.1 

0 

0 

51-60^ 

3 

2 

0 

0 

0 

61-70% 

3 

1 

0 

0 

71-80%  , 

6 

'  0 

0 

0 

0 

81-90% 

4 

0 

0 

0 

0 

91-100% 

8 

8 

0 

0 

0 

Table  2.     Principals'  perceptions  of  teacher  response- to  the  use  use 
of  computers  in  the  classroom 

Even  though  the  school  administrators  did  think  that  the  majority 
of  their  teachers  would  support  the  use  of  computer  technology  in  their 
classrooms,  when  asked  to  indicate  the  percentage  of  teachers  who  presently 
know  how  to  use  the  computer  for  educational  purposes,  the  principals  felt, 
that  very  few  of  their  educators 'were  presently  competent  in  the  use  of  the 
computer.     (Question  #17)  i     Seventy-three  percent  of  the  school  administrators 
'stated  that  less  then  10%  of  their  faculty  could  use  the  computer  effectively 
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in  the  classrpom.     See  table  3. 


Percent  of  computer  Number  of  ^  Percent  of  total 

literate  teachers  schools  ^  number  of  schools 


per  school  ,        v                '  > 

"  0-10^ 

7')  A 

11-20% 

a 

1  1 
XX 

21-30% 

i 
o 

J* 

XX 

31-40% 

1 

X 

1  L 

41-50% 

0  : 

51-60% 

1  . 

1.4 

61-70% 

0 

71-80% 

0 

81-90% 

1 

1.4 

91-100% 

1  . 

•  1.4 

Table  3.    Percentage  of  teachers  in  ^ch  school  who  know  how  to  use  a 
computer  for  educational  purposes. 

When  questioned  regarding  the  ^probable  teacher  interest  in  receiving 
instruction  on  the  use  of  computers >  the  probable  teacher  interest  level<' 
fell.     (Question  #18).    Approximately  a  third  of  the  principals  believed 
that  less  than  30%  of  their  faculty  would  wish  to  receive  instruction  in 
computers.    Twenty-two  and  four  tenths  percent  of  the  principals  ffelt  that 
78-100%,  of  the  faculty  at. their  schools  would  want  to  participate  in 
additional  instruction.    The  mode  value  oh  this  question  was  40-50%., 
suggestling  that  about  half  of  the  teachers  at  most  schools  would  be  interested 
in  further  instruction. 


PerG;^nt  of  teachers                     Number  of     :                     Percent  of  total  , 
inte|-ested  in                                schools                              number  of  schools 
furtner  instruction    .   ■  *   . '  


0-10% 
11-20%' 
21-3'0% 
31-40% 
41-50% 
51-60% 
61-70% 
71-80% 
81-90% 
91-100% 


7 

10.4 

10 

14.9 

5 

7.5 

8 

11.9 

12 

17.9 

6 

9.0 

4 

6.0 

4 

t 

6.0 

8 

9 

11.9 

3  . 

4.5 

Table  4.    Percentage  of  teachers  in  each  school  who  would  like  to  receive 
instruction  in  the  use  of  computers. 

On  question  #21  of  the  survey,  each  administrator  was  asked  to  predict 
the  usefulness  of  computer  technology.  ,  They* clearly  thought  that  the  potential 
effect  of  computers  in  the  classroom  would  be  a  positive  force  in  education. 
"Two  thirds  of  the  administrators  rated  the  future  effect  of  computers  as  very 
favorable,  one  third  felt  the  technology  would  be  favorable,  and  none  of  the 
respondents  .rated  the  computer  as  a  negative  factor. 
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Response 


Number  of 
schools 


PercePA:  of  total 
number  of  schools 


Very  favorable 
Favorable 
Neutral 
Unfavo rable 
Very  unfavorable 


44^ 
22 

1 

0 

0 


66% 

sr/o 
1% 


Table  5.    Administrators'  perceptions' of  potential  effect  of  computers 
in  the  classroom. 


The  principals  were  asked  to  indicate  tihe  ways  in  which  cbmputers  were 
being  used  in  their  schools.    The  rank  order  of  responses  is  given  ^ in 
table  6. 


Use 


NumbeV  of" schools 


Instruction 
Computer  ^iteracy 
Word  processing 
Record  keeping 
Data  manipulation 
Testing 
Other 


28 
18 
11 
8 
5 
2 
9 


Table  6.    Rank  order  of  computer  usage  in  schools. 

Question  #16  presented  the  principals  with  a  list  of  eight  items  that 
could  possibly  affect  their  decision  to  purchase. computer  equipment  in  the' 
future.    Respondents  were  asked  to  place  the  items  in  rank  order  as  to  the 
relative  importance  each  would  have  in  affecting  the  decision  making  process. 
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'     The  most  important  factors  affecting  the  decision 'to  purchase  were: 

A.  Availability  of  funds 

B.  Administrators  belief  that  computers  would , improve  education 

C.  Student  interest       .  . 

Thirty-Height  of  the  principals 'rated  availability  of  funds  as  the  number  , 
one  factor  in  deciding  to  purchase  or  not  purchase  computers*.  Forty-nine 
-  administrators -.rated  their  belief  tha't  computers  could  help  students  learn  as 
•  first  or  second,  in  importance/   No  respondent  rated  teacher  belief  in  the 

computer's  potential  to  help  students  learn  as  number  one  in  importance, 
,  however,  twenty- three  principals  rated  this  factor  as  second  in.  importance. 

,  '  «  Responses 


Importance  Student  Teacher  Teacher  Administration  Administration  Funding 
rating   interest    interest    belief    interest  ■   belief   / 


1 

10 

5  • . 

8  — 

.2. 

24 

38 

2 

16 

a 

23    ^  . 

2 

25 

4 

3 

13 

3. 

7 

4 

4 

IG 

7 

9 

7  ' 

8 

.  5 

3 

14 

14 

5 

3 

6 

6 

15 

15 

11 

3 

7 

1 

1 

8 

6 

1 

9 

1 

•  2 

7 

1 

1  " 

2 

Table  7. 

Factors  affecting  the  decision  to 

purchase 

computers. 

The  principals  were  asked  to  look  into-the  future  and  predict  the  proba- 
bility  of  their  schools  purchasing  one  or  more  computers  in  the  next  five  years. 
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The'findings  were  remarkable.  Ninety  five  percent  of  the  administrators 
expected  to  purchase  more  machines  in  the  next-five  Yeat^.    All. of  the 


school  administrators  whose  school  presen\:ly  owned  a  computer  expected  .to"- 
purchase  additional  equipment  in  the  next  five  years.  ;  ^ 

Finally,  data  was  collected -t-o 'determiTAe  whether^  the  size  of  a  school 

. .        ■  \  ■  ■     '         '^.^  ■ 

district  in  which  a  school  was  located  was  a  good  predictor  of,  the  prpba- 

■  v.    -^-^  ^  !^ ' 

bility  of  the  individual 'schools  owning, one  or  more  computers.    As 'may ^ be 

seen  in  table  9*  there  was  no  difference  of  computer  ownership  «mong  schools 

•a  ^ . 

located  ia. small,  medium,  or  large  school  districts.     Furthermore,  tdble  9  ' 

' '  ■  .  ■  ,  ■  * 

Shows  that  a  school's    membership  In 'a  small,  medium,  or  large  School 

i  ''.         ,  ■   ■■      "    '       ''^   ■      ■  ' 

district  does  not  affect  the  intention  of  principals  to  purchase^  computers 

in  the  future.  "  . 


<• 

Size  District 

>        •        .  ■     '  ■  . 

Small 

r, 

I 

Medium 

Large' 

> • Total . 

Own 

Computers 

14 

? 

14  •    '  .. 

Do  not 
Own 

Computers 

12 

13 

14     <  ■ 

39 

Total 

26 

.22 

28 

76 

Table'  8.     Size  of  school  district  vs  computer  ownership, 
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.  "«      ,      Size  of  School  District. 


1  ■  ■ ,   ■  -  .  ■ 

.'  Medium 

Large 

•.   Total  . 

/.•... 

Will  * 
Purchase 

■'^         -15  j'» 

13  ^ 

■    ■ '.    ■  ..N.17  . 

^         45         .  ■  • 

Will  not 
Purchase 

>                                   ■  '  . 

^  •  "  2  : 

• 

:            -     ■      y.     ^  ,J 

"  ■  •• 

Uncertain 

'10:'-       ;  •'  • 

.  •  7 

Total 

•  '26  ^ 

22  ' 

Table  9. 

Size  of  school' district 

*vs' probable  future  purchase  of. 

computers^ 

CONCLUSIONS  AND  IMPLICATIONS  ' 

One  pf-  the  better  known  principles  of  .diffusion ^ and  adoptipn.  of  •  innova-. 
tions  is  that,  whenever  possible,  it  is  desirable*-  to  have  upper  level  support  , 
within  an  organization  or  systemt    The  rebults  <?f^' this  ^study  suggest  that  one 
gr^up  of  important,  decision  ^makers  in  Our  educational  isystem  (th^  principals)  ' 
strongly  support  the  use  of  computers  in  formal  education.    These  administrators 
indicated  that  they  believe  that  theit  subordinates,  teachera  and  .students,  •  '  - 
would  be.  avid  supporters  of  bringing  computer- technology  .into  the  classroom.. 

Perhaps  more  important  is  the  f^ct  that  the  principals  themselves  seem  to  have^  . 

•  -  ;  .       .      •  t  '  '  .f. 

developed  a  strong  committment  to  the\belief  that  computers  will  have^  a  positive 
•  *        J       \  ■  .    <  •       -  ,       .     .  .  '    .  ■■  •  ■ 

^  effect  oh' the  education' of  ^tudents.in  the  elementary  and  higher  grad^  levels. 

The  data  show  that  roughly  95%  of  these  leaders, plan  to  purchase  their  first 

computer  .or  additional  coiiq)uters  in  the  next  five  years.-  One  hundred  percerft 

••         -  ■*!  «i  '  ' . 

of  the  principals  dt  schools  which  presently  have . computers  plan. to  inake  further 

purchases.    Thi^  information  suggests  that  educators  have  already  developed  . 

a  readiness'  to  uSe  this  educational  technology.    There  doesn't  seem  to'  be  a  , 
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difference  between  the  viene  of  educators  in  schools  located  in  small, 
medium,  and  large  size  school  systems.    Most  respondents  indicated  agreement 
as  to  the  usefulness  of  the-  computer  in  education  in  the  future. 
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School  Service  Personnel 
LEARNING  RESOURCES 
339  Graduate  Education  Building 
Fayetteville.  Arkansas  72701 
(501)  575-5100 


UNIVERSITY  OF  ARKANSAS  •  College  of  Education 


October  18,  1982 


Dear  ^Administrator: 

This  survey  is  being  oonducted  to  learn  more  about  the  use 
of  computers  in  education  in  Arkansas  schools.     A  random 
sample  of  schools  has  been  selected  and  your  institution 
is'  among  them.     Please  take  time  to  answer  the  questions. 
You  will  note  that  we  are  interested  in  the  responsesfV 
^  from  schools  which  do  not  have  computers  as  well  as  from 
those  which  do  use  this  educational  technology.     Your  in- 
put into  this  survey  is  invaluable  and  your  responses  will 
be  held  in  confidence. 

The  survey  may  be  returned  in  the  enclosed  self -addressed, 
stamped  envelope.     Your  effort  is  appreciated;  a  prompt 
reply  would  aid  us  greatly. 

Thanks  again. 

Sincerely, 


David  Carl,  Ed.  D. 
Assistant  Professor 
.Instructional  Resources 


DC/sb 
End. 


SURVEY 

rOMPTlTERS  IN  ARKANSAS  EDUCATION 


1)  Name  of  school: 

2)  Address:^  


3) 
4) 
5) 
b) 
7) 
8) 
9) 


Name  of  county;^ 


How  many  teachers  (FTE)  are  at  your  scnool?^ 
How  many  students  attend  your-  scHool?^  


10) 


What  grade  levels  are  included  m  tne  school?  .  _  

Name  of  person  responding  to  tnis  questionnaire:  

Title  (eg.  math  teacher,  principal,  library  media  specialist)^ 
Does  your  school  have  a  computer? 

YES  Cplease  continue  answering  the.  questionnaire) 

  NO  Cplease  skip  to  question  15) 

What  type  of  computer|s)  aoes  your  school  have? 


Number  of 
computers 


Brand  of 
computer 


Model 


TRS  -  80 

APPLE  II 

PET 

ATARI 

I.B.M. 

OTHER 
(specify) 


11)    \^at  dateu)  .  ^month/year)  did  your  school  purchase  the  macnine(s;? 
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12)    What  types  of  peripheral  devices  does  your  school  have.  (eg.  princer, 
plotter;  modem,  etcj? 


13)    How  is  the  computer  used  in  your  scnool? 

Instruction 

  Record  keeping 

s>       Teactiing  cqmputer  literacy 

  Testing  '  ' 

Data  manipulation  (calculating  machine) 

 ^  word  processing 

Ottier,  please  specify  '  


141    What  eauipment  problems  have  you  experienced  with  your  computer  and 

'     peSpherST  DO  you  believe  Jhat  these  proolems  affected  the  education, 
of  your  students? 


15)    Are  tnere  plans  to  purchase  one  or  more  machines,  in  tne  next  five  years'i 
^ES   NO  ■  UNCERTAIN 
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16)    Which  of  Che  following  factors  affect  the  decision  to  purchase  or  not  purchase 
-  computers  for  use  in  your  school? 
(List  the  factors- in  order  of  importance  from  1  to  9..  Consider. 
1  to  be  the  most  important  factor  and  9  to  be  the  least  important) . 

Student  interest 


Teacher  interest  in  using  tne  computer  for  keeping  track  of  student 
progress  and  records 

Teacher's  belief  that  computers  will  s  gnificantly  help  their  students 
learn 

Administration  interest  in  using  the  computer  for  management  purposes 

Administrators'  belief  that  computers  will  significantly  help  their 
students  learn    '  , 

Availability  of  funds 

Other  reasons   ■  :   ■  


17)    Approximately  how  many  teachers  presently  know  how  to  use  a  computer  for 

educational  purposes?  tnv  /iv  qny 

0%  to  10%   ^11%  to  20%  21%  to  30%   _31%  to  40%     _  »   41/.  to  50% 

81%  to  90% 


"51%  to  60% 


61%  to  70% 


71%  to  80% 


91%  CO  1003 


18)     How  many  teachers  (including  those  who  presently  know  how  to  use  computers) 

would  like  to  receive  instruction  on  the  use  of  tne  computer  in  the. classroom/  ^ 

0%  to  10%   ^11%  to  20%   ^21%  to  30%   ^31%  Co  ^0%   to  50%, 

      91%  to  100/ 


51%  to  60% 


61%  to  70% 


71%  to  80% 


81%  to  90% 


19)     In  your  opinion  how  would  students  respond  to  the  use  of  a  computer  in  the 
classroom?  ' 


percent  of  students 
 (approx* )  


Response 
.Very  favorable 
.Favorable 


.Neutral 


'.Unfavorable 
.Very  unfavorable 
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20)  How  would  the  teachers  respond  to  the  use  of  computer  in  the  classroom? 

Percen:^  of  teachers 

(ApproxQ  Respoi^se 

 Very  favorable 

  ..........  .Favorable 

 Neutral 

 Unfavorable 

.Very  unfavorable 

21)  In  your  opinion,  what  is  the  potential  effect  of  the  use  of  computers  in 
the  classroom? 

  very  favorable  • 

'  favorable 

  neutral  (no  effect) 

  unfavorable 

  very  unfavorable       '  .  > 

22)  Would  you  like  a  copy  of  the  results  of  this  study? 

YES  *   NO 
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TITLE:     Publications  of  the  Profession: 
AVCR/ECTJ.  AVI/I  L  J  ID 


AUTHORS:  Patricia  Dimond 
Michael  Simonson 
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PUBLICATIONS  OF  THf" PROFESS ION: 
AVCR/ECTJ,  AVI/II,.JID 

P,atrici.a  Dimond 
Graduate  Reaching  Assistant 


us,  DEPARTMENT  OF  EOUCATION 
NATIONAL  INSTITUTE  OF  EDUCATION 
EDUCATIONAL  RESOURCES  INFORMATION 

CENTER  lERIC) 
□  This  document  h«s  been  reproduced  as 
received  from  the  person  or  oroanizaiion 
origif^ating  it. 
U  Minor  changes  have  been  made  to  improve 
reproduction  quality. 

•  Points  ol  view  or  opinions  stated  in  this  docu- 
ment do  not  necessaniy  represent  official  NIE 
position  or  policy. 


and 

Michael  Simonson 
Professor 
Iowa  State  University 
College  of  Education 
Ames,  Iowa 


"PERMISSION  TO  REPRODUCE  THIS 
MATERIAL  HAS  BEEN  GRANTED  BY 

Michael  Simonson 


TO  THE  EDUCATIONAL  RESOURCES 
INFORMATION  CENTER  (ERIC)." 


Most  members  consider  the  Association  for  Educational 
Communications  and  Technology  to  be  a .  professional 
organization.  The  designation  "professional"  is  taken  for 
granted. ,  Little  thought  is  given  by  most  to  what  is  meant  by 
the  key  term  "professional". 

A  profession  has  at.  Veast  six  char'acateri sties: 

a.  an  intellectual  technique, 

b.  an  application  of  that  technique  to  practical 
affairs. 


c. 


I  period  of  long  training  necessary  before 
intering  into  the  profession. 


d.  an  association  of  members  of  the  profession  into  a 
closely  knit  group  with  a  HIGH.  QUALITY  OF 
COMMUNICATION  BETWEEN  MEMBERS, 

e.  a^series  of  .standards  and  a  statement  of  ethics 
that  is  enforced,  and 

f.  an  organized  body  of  intellectual  theory  constantly 
expanding  by  research. 

(Finn,  J.  "Professionalizing  the  Audiovisual 
Field,"  AUDIO-VISUAL  COMMUNICATION  REVIEW,  Vol.  1, 
No.  1,  Winter  1953,  pp  6-17.) 
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It  was  obvious  to  Finn  in  1953,  and  it  is  obvious  today,  that 
AECT  is  not  truly  "professional".  Rather,  it  is  a  quasi- 
professional  organization^  of  dedicated  practitioners  moving 
slowly  towards  real  professionalism. 

One  dynamic  force  Influencing  that  advance  is  the 
communication  program  used  by  the  Association  to  disseminate 
information  of  impact  to  the  discipline.  At  the  foundation 
of  that  communication  -system  are  the  Associaton's  periodical 
publications.  The  journals  published  by  AECT  are: 
INSTRUCTIONAL      INNOVATOR,     THE     JOURNAL    OF  INSTRUCTIONAL 
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DEVELOPMENT,  and  THE  EDUCATIONAL  COMMUNICATIONS  AND  tECHNOLGY 
JOURNAL.  ^It  is  through  these  three  publications  that  the 
Association'  establishes  a  permanent  record  of  '>^at  ^it 
considers  to  be  currently  significant  issues,  ideas. and 
insights.'  These  periodicals,  more  than  any  other  Association 
activity,  provide  to  all  a  visible  .  and  influential 
identification  of  purpose  of  the'  Association.  The 
professionalism  of  the  Association  will  be  demonstrated 
through  the  information  printed  on  their  pages. 

Recently,  each  of  these  journals  experienced  a  change  in 
editors.  In  order  to  help  these  individual s  plan  the  future 
of  their  publications,;  and  to  provide  Association  members 
with  a  better  understanding  of  these  periodicals,  a 
historical  review  was  undertaken  to  describe  -  some 
characteristics  of  each  jour^nal.  Each  •  issue  of  each 
publication  was  examined,  and  the  information  reported  in 
Tables  1-3  was  obtained.  Additionally,  information  about 
each  journal  is  provided  below. 

INSTRUCTIONAL  INNOVATOR  (AUDIOVISUAL  INSTRUCTION  prior  to 
1980)  .  ^ 

Editors:  Floyde  E.  Brooker  -  1956-57 

Anna  Hyer  -  Iss.  10,  1957-1970 

Howard  Hitchens,  Jr.  -. 1971-1982 

Current  Editor:  Lyn  Gubser 

II/AVI  ^  is  the  most  widely  distributed  of  the  Association's 
three  journals.  While  its  purpose  varies,  it  is  the  primary 
information  dissemination  tool  of  the  organization,  feature 
articles  are  generally  of  the  "position  paper"  type.  They 
are  usually  short  (2-5  pages),  and  on  topics  of  current 
general  interest  to  members  of  the  Association  and  to  users 
of  technology. 

Three  characteristics  of  II/AVI  distinguish  it  from  the  other 
two  AEQT  publications.  First,  each  issue  carries  a  large 
number  of  -  advertisements,  fr0iT\^  a  high  of  approximately 
50/issue  in  1969,  to  lows  of  9/iss^ue  in  1956  and  13/issue  in 
1977.  Also,  each  issue  carries  announcements  of  significant 
events  that  might  be  of  immediate .  inte^rest  to  readers.  Last, 
II/AVI  carries  a  variety  of  speciaT  col umns,  section?^  and 
departments  that  deal  with  specific  issuei  of  interc^t'to 
sub-groupings  of  readers.  This  "Learning  Resources" 
supplements,  "Division"  columns  and^  "Techniques"  departments 
are  notable  examples.  \ 

The  most  significant  trend  obvious  from  an  examination  of 
Table  1  is  the  steady  climb  in  the  size,  of  the  journal 
through  the  1960s,  and  the  decline;  during  the  1970s.  1969. 
seems  to  have  been  the  peak  year  for  AVI.  In  that.^ear  the 
average  issue  was  115  ;  pages,  .  had  approximately  50 
advertisements,  included  18  feature  articles  of  four  pages 
each,  and  published  63  photogr^hs.  In  1982,  by  comparison^, 
the    average  issue  of  II  was  54  pages,  hgd  11  advertisements,. 
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included  5  feature  articles  of  two  pages  each,  and  published 
13-  photographs.  While  a  weakened  economy  was  partially 
responsible  for  this  disturbing  downward  spiral? in  the  size 
of  II,  other  considerations,  less  easily  identified,  also 
contributed  to  the  weakened  stature  of  this  once  pr-oud 
journal. 


EDUCATIONAL  COMMUNICATION  AND  TECHNOLOGY  JOURNAL(ECTJ) 
(fcrmsrly  AV  COMMUNICATION  REVIEW-AVCR) 

"Editors:  William  Allen  -  1953-1969 

Robert  Heinich  -  1970-1983  ' 

Current  Editor:  William  Winn 

Managing  Editors:  Anna  Hyer  -  1956-57 

Mary.Hedquist  -  1958 

"    Mickey  Bloodworth  -  1959 

Alice  Finstad  -  1960-61 

Katherine  Rogers  -  1962-63 

Janet  Leban  -  1964-65  ' 

"  Olger  Zabludoff  -  1966-68 

Vita  Parfente  -  1969-81 


The  oldest  of  the  Association 's  three  periodicals,  ECU 
publishes  papers  on  theory,  development  and  research  related 
to  technological  processes  in  education.  Generally,  ECTJ  is 
considered  a  research  and  theory  journal.  Feature  articles 
typically  contain  descriptions  of  scientific  experimentation 
complete  with  hypotheses,  statistical  tables  and  levels  of 
significance. 

ECTJ  has  experienced  a  rise  and  fall  somewiiat  similar  to  that 
experienced  by  II.  During  the  1950s,  an  issue  of  AVCR  was 
approximately  75  pages  Ipng  and.  contained  five  feature 
articles,  each  of  about  12  pages.  During  the  1960s  and  early 
1970s,  an  average  issue  of  AVCR  was  approximately  125  pages. 
During  this  period  of  plenty,  each  issue  typically  contained 
6  or  7  research  or  theory  papers  of  approximately  fifteen 
pages  in  length.  During  the  last  decade,  AVCR  (ECTJ  since 
1978)  decTined  in  size  to  approximately  100  pages  per  issueC 
and  more  recently  70  pagfes).  In  the  most  recent  three  years 
of  ECTJ.  an  average  journal  contained  four  or  five  feature 
articles  of  approximately  14  pages  in  length. 

JOORNAL  OF  INSTRUCTIONAL  DEVELOPMENT  (JID) 

Editors:  Kenneth  Silber,  Chair  of  Editorial  Board 
and  Robert  Heinich,  Consulting  Editor 
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-  1977 

Kenneth  Silber  -  1978-82 


■  Kent  Gust afson,  Guest  Editor  -  1982 
CurB^ent  Editor:  Norman  Higgins  -  1983- 

The  JOURNAL  FOR  INSTRUCTIONAL  DEVELOPMENT  was  originally 
begun  by  the  Division  for  Instructional  Development (DID)  of 
AECT.  This  journal  was  proposed  because  many  AECT  members 
believed  that  the  instructional  development  process  was  a' 
viable  and  growing  technique  influencing  the  improvement  of 
education  and  training  at  all  levels  and  in  all  settings. 
The.purpose  of  JID  was,  and  is,  to  contribute  to  the  analysis 
and  improvement  of  instructional  development  in  the  form  of 
quality,  professionally-oriented  articles,  and  to  stimulate 
cormiunication  between  theoretically  and  practically  oriented 
instructional  developers. 

The     Journal     carries    articles    related    to  instructional 
development  within  the  following  parameters:* 

1.     theories,     models     and.    conceptual     framework  of 
instructional  development;  a. 

2.  techniques    for    deisigning  and  evaluating  instructional 
systems;  ^■ 

3.  reports   on    evaluations    of    instructional  development 
.  projects; 

-  4.  case  studies  of  instructional  development  projects...  . 

The  focus  of  JID  is  on,: 

1.  the  performance  of  the  instructional  development  process; 

2.    the   management    or  implementation  of  the  instructional 
development  process;  i 

3.  the  teaching  of  the  instructional  development  process. 

Since  JID  is  a  relatively  new  publication  there  are  few 
trends  obvious  from  an  analysis  of  Table  3.  Generally,  a 
typical  issue  of  JID  has  had  forty  pages,  with  four  or  five 
feature  articles.  Advertising  has  appeared  periodically,  but 
not  routinely,  and  photographs  have  been  rarely  included. 


SUMMARY: 


Communication  for  professional  development  might  be  a  phrase 
used  to  describe  the  purpose  of  AECT's  three  periodical 
publications..  In  the  last  three  decades  these  three  journals 
have  published  over  3450  feature  articles  written  by*4208 
authors  (3424  men  and  784  women)*  Certainly,  these  stati'Stics 
indicate  a  dramatic  influence  on  the  professional  growth  of' 
AECT.  ^ 
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Any  analysis  of.  these  three  periodicals,,  even  a  brief  one 
'such  as  this  paper,  would  be  incomplete  if  it.did'not  call 
attention  to  ..the  drastic  decline  in  the  apparent  impact  of 
two  of  these  journals  during  the  last  ten  years."  Certainly, 
this  problem  is  one  of  the-most  critical  .for  the  Association 
to  address.  •  Possibly,  the  three  new  .editors  of  these 
publications  wi  .11  reverse  this  unfortunate  trend.  The 
professional izaf ion  of  Educational  Communications  and- 
Technology  is  directly  related  to  the  success  of  these 
journals,  "and'  while  size  indicators  are  definitely  not  the 
most  significant available,  they,  do-  provide  considerable 
cause  for  concern.  .  • 
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A  SIGNAL  DETECTION  ANALYSIS  OF  DIGITIZED  AND  PHOTOGRAPHIC  IMAGE  MODES 
AND  COLOR  REALISM  IN  A  PICTORIAL  RECOGNITION  MEMORY  TASK 

ABSTRACT 

in  this  study,  signal  detection  theory  analysis  is  used  to  investigate  the  relative 
'  effectiveness  of  digital  versus  photographic  images  in  a  pictorial  recognition  memory 
task.  ^  , 

«* 

Digital  images  are  the  result  of  advances  in  computer  graphics  and'digital  image 
processing  and  may  facilitate  the  recognition  of  Images  by  human  subjects.  Jhe 
ability  to  manipulate  the  pseudocolor  in  the  digital  image  can  result  In  forms  and 
arrays  which  can  be  more  easily  distinguished  from  one  another,  thereby  increasing 
the  probability  of  a  particular  image  being  recognized. 

Subjects  consisted  of  96  colfege  students.   A  2x2  balanced  factorial  design  was 

employed  to  test  eight  hypotheses.  The  four  groups  are:  (1)  Digitized  black  "and  white 

*  ... 

(DBW).  (2)  .Digitized  Pseudocolor  (DPC).  (3)  Photographic  black  and  white  (PBW),  and 
(4)  Photographic  Realistic  Color  (PRC)*  The  original  pictorial  materials  in  the  study 
were  selected  from  the  pictorial  materials  developed  by  Berry  (1977),  Those,  pictorial 
materials  (140  35mm  in  B&W  and  in  Color  )  were  manipulated  photographically  and 
by  the  image  processing  system  (PRL)  to  produce  the  four  treatments. 

A  two-way  anova  and  one-way  anova  followed  by  Tukey-B  multiple  comparison 
test  were  conducted  on  three  of  the  signal  detection  theory  parameters,  d',  A'  and  Aq 
to  test  the  study  hypotheses  and  the  differences  among  the  experimental  groups  at 
significance  level  a=  .05. 
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Introduction 

Computer  graphics  and  digital  image  processing  ar.e  providing  a  relatively  new 
and  rapidly  growing  type  of  pictures  known  as  the  digital  images  and  will  be  termed 
here  as  digital  imagery  mode  as  opposed  to  the  photographic  imagery  mode.  Digital 
images  are  numerical  representations  of  different  types  of  pictorial  methods,  including 
B&W  photographic  pictures,  by  using  different  types  of  sampling  and  quantization 
techniques   of   gray    levels.      Computers   can   manipulate   the  psycho-physical 
characteristics  of  pictures  by  processing  their  digital  forms.  As  a  result,  pictures  gain 
better  contrast  and  better  quality.   Pseudo-color  can  be  added  to  pictures  according 
to  the  gray  levej  of  their  elements  which  are  called  pixels.  The  use  of  color  in  digits! 
pictures  with  suitable  choices  of  shade,  degree  of  brightness  and  level  of  saturation 
will  increase  the  amount  of  information  that  can  be  conveyed  .  This  is  based  on  the 
psy.chological  fact  that  the  human  visual  and  perceptual  system  can  easily  discern 
thousands  of  shades  and  intensities  of  color  but  only  20  to  30  shades  of  gray 
(Gonzalez.  1977).  Psycologically.  in  view  of  the  cue-summation  theory  (Severin,  1967) 
in  learning,  color  adds  more  cues  that  aid  the  learner  in  processing  and  recognition 
of  pictorial  information.  There  are  some  speculations  and  theoretical  views  that  claim 
that  digital  images  with  enhancement  taking  place  become  more  suitable  for  human 
processing  and  recognition  (Moik.  1980).    Digital  images  are  characterized  by  being 
discrete  in  their  gray  level.    The  display  of  digital  images  at  some  magnification 
power  makes  the  picture  elements{pixels)  start  to  be  visible.   The  quality  of  digital 
images  depends  on  the  display  subsystem  of  the  digital  image  processing  system  and 
the  method  used  in  making  hard  copies  such  as  slides  or  prints.   Slide-making  and 
print-making  equipments  are  started  to  be  parts  ii.  the  image  processing  systems, 

t 

131 

Hi 


but.  they  are  not  avai^able  in  most  research  laboratories  of  image  processing. 
Photographing  the  screen  of.  the  display  subsystem  of  the  image  processing  sytems 
is  considered  a  true  way  of  obtainiftg  the  picture  resolution  and  grey  level  (Sze. 
1982).   This  method  is  largely  used  to  make  hard-copies  of  the  digital  images.  On 
the  other  hand,  the  conventional  photographic  mode  provides  a  more  realistic 
representation  of  the  real  situations  such  as  realistic  color    This  color  realism,  in 
view  of  realism  theories  (Dwyer.  1967).  is  claimed  to  be  more  effective  in  pictorial 
processing  and  recognition.   The  -relative  effectiveness  of  both  the  imagery  modes.* 
digital  and  photographic,  in  designing  effective  visual  communication,  iconic,  delivery 
\^nd  representation  of  information,  and  visual  learning  can  not  be  predicted,  without 
systematic  research.   Realism  theories  as  well  as  the  cue-summation  theory  can  not 
easily^ be  applied  to  predict  the  effectiveness  of  the  two  imagery  modes  simply 
because  studies  have  reveale'tf-some  inconsistencies  (Berry,  1982).   Extensive  studies 
are  needed  \to  investigate  the  effectiveness  of  the  two  imagery  modes,  digital  and 
photographic  rnodes  and  the  type  of  color  In  pictorial  recognition  memory  task. 


Rational  of  The  Study  >  , 

Digital  images  are  considered  a  potential  s^ource  of  visuals  for  visual  learning  and  * 
computer  assisted  instruction  (CAI).  Research  is  needed  to  examine  the  effectiveness 
of  the  digital  image  attributes  in  the  design  of  effective  visual  learning  and 
instruction.   Pseudo-color  and  enhancement  are  two  attributes  of  the  digital  images 

that  need  to  be  studied  to  discover  their  effect  and  function  in  visual  learning  and 

'        ''  ■  ■ 

recognition. 

The  function  of  pseudo-color  in  picture  processing  is  to  increase  the  effective 
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vlewinc,  o.  ,hs  gray  scale  o.  ma  oricjina,  ima„a  (Andrews,  ,974,.  Tha  s.udy  o,  ,ha 
a,.ec«vanass  o,  imaga  anha.ceman.  naads  ,o  be  earned  on  In  an  objeCye  way.: 
Andrews  (,979)  haa  pointed  ou,  the  diHlcoUy  found  in  the  eyaiuation  of  optlmun, 
coior  mapping  In  ,he  pseudocolor  because  of  the  subieciyi.v  of  both  enhancement 
and  color  yie«,lng.  Hall  (1979)  has  pointed  out  that  the  quality  imptoyement  in  image 
enhancemem  is  not  obiectiyely  defined.  One  way  to  find  solutions  to  such  problems 
is  to  conduct  controlled  experiments  to  stud,  the  effectiyeness  of  differem  digital 
image  enhancements  in  visual  learning  tasks  such  as  pictorial  recognition  memory. 
Llpkln  and  Rosenfeld  (1970)  in  their  book,  Immn  Prnro»inn  and  Psychoplctorics,  hay. 

Stated  that:  " 

The  art  of  picture  processing  by  computer  has  reached  the  point  where 
on-lir  "al- time  manipulation  of  images  Is  now  possible,  th,s  rnaking 
"easible  to  conduct  controlled  experiments  of  the  perception  of  natural 
,  pictures  ...  (p.  vii)  .  ^ 

This  experimental  approach  to  study  the  effectiyeness  of  image  processing  and 
enbancement  on  the  human  yiewef^  perception,  understanding,  and  recognition 
^defines  the  humaaJInk  in  the  image  processing  system  (Hall.  ,979).  Such  a  link 
between  the  indlyidua,  and  the  digitized  image  in  comparison  with  the  photographic 
image  and  color  realism  should  be  subjected  to  extensive  studies. 

■v.  .  tf 

The  presence  of  color  In  visual  learning  and  memory  Is  one  of  thi  major  Issues  In 
the  design  of  media  for  learning  and  instruction.  Studies  which  have  been  carri«l 
out  on  color  and  pictorial  memory  have  resulted  In  a  set  of  contradictory  findings. 
Myatt  (,974)  carried  out  a  study  on  pictorial  attributes  and  pictorial  recognition 
memory  .  In  that  study,  Myatt  (,974)  found  that  color  didn't  appear  to  be  a 
Significant  factor  in  pictorial  recognition  memory  In  any  of  the  three  experimental 
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'groups.     Mvatt  founcl  also  that  color  didn't  appeari  to  be  a  significant  factor  in 

recognition  memory  at  any  level  of  the  three  levels  of  pictj)riai  information:  low, 

medium,  and  high.    Studies  (Berry,  1974;  Dwyer^  1971)  concluded  that  color  is  a 

significant  dimension  in  the  design  of  instruction.   >  The  same  conclusion  was 

supported  by  later  studies.    Color  was  found  to  increase  or  to  improve  pictorial 

recognition   memory   more   than   black   and   white  :presentatioris    (Berry,  1977r 

Wieckowski,  1979;  Chute,  1980;  Lertcha)olarn,  1981).    In  a  review  of  color  and  the 

learner,  research  shows  that  learners  do  prefer  color  in  media  presentations^(Descy, 

1981)     Studies  that  investigated  the  color  realism  showed  that  there  was  no 

■   •  ■'    h  :  ' 

significant  difference  between  the  realistic  and  the  ndn-renlistic  color  in  pictorial 

'    ^-  .    ■  ■  ^ 

recognition  memory  (Berry,  1977;  Lertchalolarn,  1981). 

The  Signal  Detection  ThetSry  (SOT)  and  Pictorial  Recognition  Memory 

Research  methods  in  recognition  memory  are  more  stiandardlzed  than  methods  of 
data  analysis  used  by  researchers.  The  recent  applications  of  the  SDT  model  m 
human  perception,  detection,  attention!  vigilance,  inspection,  and  recognition  studies 
have  made  researchers  like  Murdock  (1982),  Berry  (1982),  and  Swets  and  Pickett 
(1982)  argue  against  the  use  of  other  approaches  applied  by  researchers  in  measuring 
the  recognition  memory  as  being -inadequate.  In  typical  old-ne\y  recognition '^memory 
experiments  and  elsewhere,  researchers  have  used  different  measures  of  accuracy  of 
the  discrimination  between  old  and  new  items  such  as:  the  conditional  probability  of 
old  items,  the  conditional  probability  of  the  old  items  paired  with  the^  conditional 
probability  of  correct  rejection,  the  overall  probability  of  conrect  responses,  the  a 
posteriori  of  old  items,  and  the  ratib  of  the  a  posteriori  probability  of  old  items  to  the 

   ■    ■    134  . ^   
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a  posteriori  .  Swets  and  Piclcett  (1982)  have  warned  against  the  use  of  those  because 

they  do  not  take  into  account  tlie  decision  criterion.    IVIurdock  (1982)  says  that 

decision  factors  certainly  affect  perforniance  on  many  tests  of  recognition  memory 

and  this  may  lead  to  erroneous  conclusions  on  the  part  of  the  experimenter.. 

'Murdock  (1982)  and  Berry  (1982)  agree  that  using  signal-detection  analysis  in 

recognition  rhembry  provides  the  statistic\d'  (d-prinrie)  that  characterizes  the  overall 

accuracy  that  combines  both  old  items  and  new  items.  The  d'  index  used  in  Signal 

Detection  Theory  (SDT)  has  been  described  in  various  publications  and  research 

articles  (Green,  1966;  Swets,  1964;  Pourbon,  19Z8,- SWets,  1982;  Berry,  1982).,  The 

accuracy  and- the  application  of  d'  in  pictorial  recognition  memory  have  been 

demonstrated  by  Berry  (1982).   The  SDT  index  d'  has  been  supported,  preferred. -and 

justified  as  an  adequate  measure  of  recognition  memory  for  its  depth  and -accuracy 

■  =  <=    ■  -        •■    ■    -  ■ 

(Miirdock.  1982.*  Berry.  1982..  Banks.  1970;  Lockhart  &  Murdock.  1970.- Murdock.  1964). 


The  SDT  index  d'  assumes  that  the  observer  establishes  normal  equl-varlance'^ 
distributions  of  the  memory  trace  streTigth  of  the  old  items  (O)  (Signal  +  Noise)  and 
the  new  items  (  N  )  (Noij^e)  (Murdock,  1974).  Moreover,  d'  is  indetermined  when 
either  the  hit  rate  is  one  or  the  false  alarm  rate  is  zero  (Borch,  1975).  The  Violations 
of  that  distributional  assumption  result  in  erroneous  conclusions  concerning  d', 
meaningSassness  of  d',  and  a  significant  correlation  between  d'  and  the  criterion  0 
(Beta).  Long  and  Wagg  (1981)  have  found  from  empirical  data  In  situations  like 
vigilance,  visual  search,  and  auditory  recognition  that  the  violation  of  the 
distributional  assumption  has  resulted  in  an  inadequacy  of  d'.  Researchers  like 
Norman  (1964).  Pollack  and  Norman  (1964).  Hodos  (1970),'  Richardson  (1972).  Berch 
(1975).  Craig  (1979).  and  Long  and  Wagg  (1981)  have  started  to  consider^  non- 
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parametric  measures  for  detection  and  recognition,  -  The  area\under  the  Receiver. 
Operating  Characteristic  graph  (ROC-Curve)  provides  two  other  parameters  :  A'  and 
A- .  A'  and  Aq  are  distribution-free  measures  of  response  sensitivity  and  have  been 
used  in  detection  and  recognition.  The  index  A'  has  been* described^ and  developed 
by  Norman  (1964)  and  Pollack  and  Norman  (19§.4).  The  computational' formula  of  A' 
was  developed  by  Grier  (1971)  and  was  used  in  research  by  Craig  (1979)  in  vigilance 
and  by  Berch  (1975)  in  recognition  meqiory.  The  measure  Aq  is  another  measure  of 
the  area  under  the  SDT  ROC  curve.  Jit  has  been  described  by  Green  and  Swets  (1966) 
and  used  by  Craig  (1979).  Since,  in  old-new  recognition  memory  experiments,  the 
distributignal  assumption  of  d'  can  not  be  verified,  the  author  will  use  two 
distribution-free  measures  of  recognition  memory  (A'  and  Aq)  besides  the  SDT 
parameter  of  detectability  (d'). 

The  Problem  of  The  Study 

The  present  study  was  designed  to  investigate  the  interactive  effects  of  digiti)l 
imagp  and  photographic  image  modes  and  color  realism  on  a  pictorial  recognition 
memory  task.  The  Signal  Detection  Theory  (SDT)  was  usjd  to  model  the  recognition 
memory  task.  Three  indexes  from  the  SDT  were  used  to  analyze  the  pictorial 
recognition  data:  the  Aq.  The  problem  was  defined  In 

the  following  research  questions: 

1.  Is  there  a  significant  interaction  between  color  modes  (  B/W  and.  color 
presentation)  and  the  imagery  modes  (  digital  and  photographic  images)  in 
a  pictorial  recognition  memory  task? 

2Js  there  a  significant  main  effect  of  color  presentation  (B/W  and  color 
modes)  in  a  pictorial  recognition  niemory  task? 
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3.  Is  there  a  significant  main  effect  lOf  imagery  modes  (digital  and 
photographic  image  modes)  in  a  pictorial  recpgnition  memory  task? 

4.  Is  there  a  significant  difference  betwe'en  the  means  of  the  four  treatments, 
digitized  B&W,  photographic  B&W,"  digitized  pseudocolor  ,  and 
photographic  realistic  color,  in  a  pictorial  recognition  memory  task? 

5.  Is  there  a  significant  difference  between  the  realistic  color  in  photographic 
images  and  the  pseudocolor  in  digitized  images  in  a  pictorial  recognition 
memory  task? 

6.  Is  there  a  significant  difference  between  digitized  B&W  images  and 
photographic  B&W  images  in  a  pictorial  recognition  memory  task? 

7.  Is  there  a  significant  difference  between  digitized  pseudocolor  images  and 
digitized  B&W  images  in  a  pictorial  recognition  mlmory  task? 

8.  Is  there  a  significant  difference  between  photographic  realistic  coloc  and 
photographic  B&W  images  in  a  pictorial  recognition  memory  task? 

The  significance  of  The  Study 


There  are  three  major  contributions  of  this  study  In  three  aspects:  practical, 
theoretical  arid  methodological. 

1.  In  the  practical  aspect  this  study  will  provide  contributions  to: 

The  discovery  of  the  effective  use  of  digital  images  in  designing 
Compute/, Assisted  Instruction  (GAI)  and  visual  learning.  ^ 

The  discovery  of  the  effectiveness  of  both  image  enhancement  an^  , 
pseudo-color  addition  in  pictorial  recognition  nr.emory. 

The  discovery  of  the  relative  effectiveness  of  the  realistic  color  and 
the  pseudo-color  in  pictorial  recognition  memory. 

D.  The  discovery  of  the  effects  of  th^i  manipulation  of  some  physical 
characteristic  memory.,, 

2.  In  the  theoretical  aspect,  this  study  is  an  investigation  of  the  contention 
of  reaHsm  theories  versus  cue-summation  theory  in  the  prediction  and 
interpretation  of  visual  learning  as  applied  to  different  imagery  modes. 


A. 
B. 
C. 
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3.  In  the  methodological  aspect,  this  study  is  using  the  Signal  Detection 
Theop'  l(.  the  analysis  of  t/ie  recognition  data.  Two  new  parameters  from 
the  ROC  curve  in  SDT  (a  '  and  Aq)  were  used  in  the  analysis  besides^the 

•   use  of  the  d'  (the  index  of  SDT  detectability).       '  -  >^ 

*  Methodologies  and 'Procedures 

Th6  Subjects 

*       •  *  - 

The  subject  of  this  study  were  university  students:  graduates  and  undergraduates  . 
Students  signed-on  for  partipipation.  Sign-on  scheets  were  made  available  to 
students  in  most  of  the  University  of  Pittsburgh  libararies,  classes,  reserve  book 
rooms  and  bulletin  boards.  From  a  total  of  120  subjects  participating  in  the  study,  96 
comjDleted  the  experiment  according  to  the  instructions. 

Subjects  were  randomly  assigned  to  the  four  experimental  groups  of  the  2X2 
factorial  design.  Data  were  collected  on  the  subject's  age,  major  of  study,  study  level 
and  sex.  The  Subjects'  ages  were  in  the  range  17\to  57,  the  average  was  27.7  years, 
the  median  was  24  yea;-.s  and  ^ne  subject  did-  not  ref>ort  his/her  age.  Subjects  were 
majoring  in  48  different  areas  of  study.  Fourty  five  oKhe  subjects 'were  males,  50 
were  females  and  six  students  didn't  report  their  sex.  Fifty Vur  of  the  subjects  were 
undergraduates,  32  were  graduates  and  10  did  not  report  their X"dy  level.  These 
descriptive  data  show  that  subjects  were  varied  in  their  age,  major  of\tudy,  level  of 
study  and  sex.  Subjects  were  evenly  distributed  between  the  four  experlQiental 
groups:  Group  1.1,  Group  1.2,  Group  2.2  and  Group  2.2. 
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The  Study  Variables  and  Design 


In  this  study,  there  were  two  independent  discrete  variables  (factors)  and  one 
Pictorial  recognition  memory  was  the  dependent  variable  which  has  been  measured 
by  the  use  of  the  signal  detection  analysis.  The  following  are  the  variable 
classification  and  their  codes  as  used  in  data  processing  and  analyses: 

1.  The  color  modes  of  the  images:  B&W  mode  and  the  color  presentation 
mode.  Color  modes  (Color)  was  used  as  one  of  the  two  factors  in  this 
study. 

2.  The   imagery   modes   of  the   pictures:      digital   imagery   mode  and 
photographic  Imagery  modes  (Immode)  was  the  second  factor  of  the" 
study  design. 

3.  The  recognition  memory,  the  dependent  variable,  as  measured  by  the 
signal  detection  parameters  in  two  types  of  analyses:  Yes-No  signal 
detection  parameters.  The  Yes-No  signal  detection  parameters  used  to 
measure  recognition  memory  were:  d'.  A'  and  AQ{area  under  ROC 
measure  described  by  Green  and  Swets  (1966)). 


To  investigate  the  research  questions  of  this  study,  a  2X2  balanced  factorial 
experimental  design  was  used.  This  design  is  illustrated  in  Figure  1. 


Figure  1  shows  that  Group  1.1  performed  the  pictorial  recognition  task  using  the 
digitized  B&W  pictures(DBW),  Group  1.2  performed  the  pictorial  recognition  task  using 
the  digitized  pseudocplor  pictures(DPC),  Group  2.1  performed  the  pictorial  recognition 
task  using  the  photographic  B&W  pictures(PBW)  and  Group  2.2  performed  the  pictorial 
recognition  task  using  the  photographic  realistic  color  pictures(PRC). 
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COLOR  MODES 
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Figure  1:    The  2x2  Experimental  Design  of  The  Study 


Study  Materials 

A  sample  of  140  2k2  slides  drawn  from  a  large  pool  of  700  slides  developed  by 
Berry  (1977)  and  used  in  research  by  Berry  (1977)  Stnd  other  researchers  (WIeckowskI, 
,1980;  Lertchalolarn,  1981;  Berry,  1982),  was  the  original  35mm  pictorial  stimuli.  The 
140  were  in  both  B&W  and  realistic  color  versions.  These  140  slides  were 
randomized  and  randomly  divided  by  a  computer  program  using  the  random-number- 
generator  function  between  the  old  set  (O)  and  the  new  set  (N)  (distractors).  Tl?e 
order  of  this  randomization  and  the  assignment  were  used  to  construct  the 
recognition  test  of  the  pictorial  recognition  memory  task.  The  random  division 
resulted  in  66  slides  to  the  old  ahdi;^r>lides  to  the  new  set. 
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The  square  image  format  is  the  most  common  format  in  riiqital  imaqe  orocessinq 
( 512x512  P'J^els).  This  format  is  the  one  that  is  also  supported  by  the  Patiern 
Recognition  Laboratory  System  (PRL)  in  the  Department  of  Electrical  Engineering  at 
the  University  of  Pittsburgh.  A  simplefled  functional  diagram  based  on  Sze  (1982)  is 
shown  In  Figure  2. 

The  Image  Input  subsystem,  particularly  the  Optronic  C-400.  was  interfaced  to 
digitize  the  central  square  portion  of  the  35mm  B&W  negatives  which  was  about 
24x24mm.  So.  the  original  had  to  be  trimmed  to  produce  the  photographic 
treatments  to  match  the  digital  image  contents.  An  Optical  Slide  Duplicator  was  used 
in  producing  the  photographic  B&W  (PBW)  and  the  photographic  realistic  color  (PRC) 
from  the  original  35mm.  The  above  copying  system  was  copying  only  the  centi-al 
portion  of  each  35mm  slide  (24x24mm)  by  masking  the  rest  of  the-  slide  scene. 

The  production  of  the  digitized  treatments  was  done  by  first  digitizing  tlie  140 
35mm  negatives  of  the  original  B&W  version  using  the  high  precision  Optronic  C-400 
image  input  subsystem.  The  140  piqtures  were  digitized,  satisfactorily  matching  thair 
counterparts  in  the  photographic  treatments. 

Three  different  digital  Images  were  selected  randomly  and  enhanced  utilizing  the 
PRL  image  processing  routines  by  two  different  pixel-by-pixel  Image  contrast 
corrections  (Todhunter,  1978).  The  same  digital  Images  were  pseudo-colored  by  four 
different  pseudo-color  tables.  .  Twenty  one  slides  were  photographed  from  the 
RAf^TEK  display  subsystem  of  the  PRL  v\(,here  photographing  the  RAMTEK  display  is 
considered  the  best  way  to  get  a  hard-copy  of  the  digital  Image  (Sze,  1982)  .  These 
21  slides  were  as  follows: 
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Figure  2: 


The  PRl  Facilitv  A  Functional  Block  Diagram 
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^  1.  Three  original  digitized  B&W  images  (no  enhancement  done),  ; 

2.  Three  digitized  B&W  images  enhanced  by  method  one  of  the  two 
methods. 
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3.  Three  diqitizeri  BAW  inuicies  enhanced  hv  the  other  method. 

4.  Three  digitized  pseudo-colored  images  by  pseudo-color  table-1, 

5.  Three  digitized  pseudo-color  images  by  pseudo-color  table-2, 

6.  Three  digitized  pseu'^O'COlor  images  by  pseudo-color  table-3,  and 

7.  Three  digitized  pseudo-colored  images  by  pseudo-color  table-4. 

Those  21  slides  were  randomized  and  displayed  to  a  total  of  30  judges  from  the 
same  population  (university  students)  using  a  seven  point  judgment  scale.  The  seven 
points' were:    Extremely  Poor,  Very  Poor,  Poor,  Fair,  Good,  Very  Good,  and  Extremely 

\  ■  r 

Good  to  each  picture  of  the  21  pictures. 

The  judgment  data  were  analyzed  by  using  One-Way  Analysis  of  Variance  with 
Repeated  Measures  (treatments)  followed  up  by  Tukey-*^  inultiple  comparison  test. 
The  judgments  for  the  digitized  B&W  versions  were  significant  (Fr3.28;  df»2,58;  P- 
0.044),  The  digitized  B&W  (no  enhancement)  was  found  to  be  judged  significantly 
higher  than  one  of  the  two  other  methods  and  just  high®--  than  the  other.  So;  the 
digitized  BSdW  (DBW)  treatment  was  produced  by  photographing  the  original  digitized 
B&W.images.  • 

The  judgments  for  the  pseudo-color  vtersions  (four  methods)  were  not 
significantly  different  (F-2.60;  df»3,87;  P-0.06)-  The  pseudo-color  method  that  was 
judged  to  be  the  highest  was  used  in  the  production  of  the  digitized  piseudo-coJor 
(DPC)  treatment 

■      *  •          •    ■  ■   1  ■  • 
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Thfi  Procficlures  of  The  EHperimentation 


1.  Instructions  about  the  task  sequence  and  the  subject  role  and 
performance  were  read  and  explained  by  the  investigator.  All  means  were 
used  to  make  those  instructions  fully  understood  by  subjects  individually 
or  in  groups. 

2.  Subjects  were  assigned  randomly  to  the  ifour  experimental  treatments 
prior  to  coming  to  the  experimerftation  session.  Subjects  assigned  to  the 
color  treatments  were  not  to  be  color  blind.  If  color  blindness  was 
detected,  the  subject  would  have  to  be  excluded  from  the  analysis  None 
was  excludexl  from  the  analysis  because  of  color  blindness. 

3.  The  old  set  (66  slides)  was  projected  at  the  rate  of  500ms  (half  a  second) 
using  the  ^computer  based  projection  system  described  in  the  study 
Instrumentation. 

4.  Subjets  were  given  a  five  minute  break  before  proceeding  to  take  the 
pictorial  recognition  memory  test  (T).  . 

5.  The  pictorial  recognition  memory  test  (T)  was  projected  at  the  rate  oj  10 
seconds  to  each  slide  using  tf\e  computer  based  projection  system 
described  in  the  instrumentation  section.  Subjects  wore  required  to 
respond  to  each  picture  in  the  test  using  an  answer  form  that  was 
combining  both  the  Yes-No  method  and  the  Confidence  Rating  method. 
The  number  of  each  slide  in  the  pictorial  recognition  memory  test  (T)  was 
projected  in  a  window  at  the  lower  right  corner  of  the  picture  to  guide 
subjects  to  mark  the  answer  to  the  correct  number. 


The  administration  of  the  pictorial  recognition  memory  task  was  done  individually 
and  in  small  groups  in  a  classroom-like  situation.  The  projection  was  from  the  rear 
screen.  It  was  an  interactive  computer  based  projection  system.  The  system 
components  were: 

1.  Two  Kodak  Ektagraphic  III  AF  slide  projectors  (labeled  PR#1  and  PR#2), 
one  super-wide  angle  projection  lens  for  PR#2,  extension  cables,  one 
projector  stand  and  different  high  projection  tables. 


The  Study  Instrumentation  and  Environment 
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2.  One  Commodore  SunerPET,  SP9000  Microcomnuter  with  96  Kb  RAM  and 
dual  processors  :  the  6502  processor  isame  as  the  Commodore  CBM  8032 
microcomputer)  and  the  6809  prdcesjor  with  Waterloo  Micro  Software  ( 
MicroBASlC.  MicroFortram,  MicroPASCAU  MicroAPL  MicroCOBOL  6809 
Assembler  Linker-Loader,  Monitor  and  MicroEDITOR).  One  CBM  8050  dual 
drive  floppy  disk  of  approximatelV  1  MB  of  storage. 

3.  One  Projector  Interface  was  developed  and  assembled  by  the  investigator 
to  be  used  in  Pictorial  Recognition  Memory  Research.  The  Projector 
Interface  is  connected  to  the  IEEE-488  Parallel  User  Port  of  the  SuperPET 
on  the  6502  processor  mode  via  an  assembled  cable.  The  Projector 
Interface  was  connected  to  the  two  slide  projectors:  PR#1  and  PR#2.  The 
Projector  Interface  was  driven  by  the  XbNTROL  PROGRAM"^  written  in 
Commodore  BASIC  4.0.  The  execution  of  the  CONTROL  PROGRAM  was 
controlled  by  the  Real-Time  Clock  in  the  computer  system. 


The  projector  PR#2  Was  equipped  with  the  super-wide  projection  lens  and  was 
used  to  project  the  pictures  of  the  old  set  (0)  and  the  pictorial  recognition  memory 
test  (T)  on  the  screen^  while  the  projector  PR#1  was  projecting  the  picture  number  on 
the  window  in  the  pictorial  recognition  memory  test  (T).  The  program  "CONTROL 
PROGRAM"  was  driving  the  two  projectors  according  to  the  pictorial  recognition 
memory  task  specifications  in  the  program.  This  program  was  also  printing  on  the 
SuperPET  CRT  the  slide  number  currently  on  the  screen.  The  user  had  to  load  and 
change  the  carousels  on  the  projectors  as  the  task  progressed. 


The  total  projection  time  for  the  old  set  (O),  66  slides,  was  one  minute,  29 
seconds  and  149  milliseconds.  The  projection  time  for  the  pictorial  recognition 
memory  test  Part#l  (slides:  1-70)  was  12  minutes,  48  seconds  and  883  milliseconds 
.The  projection  time  for  the  pictorial  recognition  memory  test  Part#2  (slides:  71-140) 
was  12  minutes,  48  seconds  and  883  milliseconds  which  was  the  same  as  Part#1. 
The  subjects  were  given  a  five  minute  break  after  the  presentation  of  the  old  set  (0) 
before  the  beginning  of  the  pictorial  recognition  memory  test  (T)  .  The  total  time  of 
the  experiment  vy/as  32  nrjnutes,  48  segpgi^  and  915  milliseconds. 
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The  Computational  Procedures  of  The  SDT  Parameters  of  Recognition 


The  computational  procedures  of  Yes-No  signal  detection  parameters  for  the 
pictorial  recognition  memory  ,  d',  AJAq,  were  done  from  the  2x2  signal  detection 
matrix  (  sometimes  called  the  2x2  stimulus-recognition  matrix).  The  construction  was 
based  on  the  analogy  between  the  detection  and  recognition  processes.  The  old  set 
(O)  is  viewed  as  (Signals, +  Noise)  and  the  new  set  (N)  .the  distractors  ,  is  viewed  as 
(Noise  Only)  as  in  the  signal  detection  terminology.-  Figure  3  shows  the.  2x2 
SDT/Stimulus-Recognition  matrix  that  summarizes  the  SDT  approach  to  the. pictorial 
recognition  memory  processes. 
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Figure  3:    The  2x2  SDT/Stimulus-Recognition  Matrix 
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The,above  mentlonetl  SDT  measures  of  pictorial  recognition  memory  were  computed 
by  the  following  formulae: 


cJ'  =  2[P(o|0)]  -  2[Pto|N)J 

t  ■  i    ■       '  " 

and  I 

A'=.5+{l(P{o|0)-P(o|N))|l  +P(o|0)-P(o|N))l/[4P(olO)(1  -P{olN))]} 

1 

'    ■  •  1 

and 

Aq  =  {P(o|0)  +  tl  -  P{o|N)l}/2 

This  estimator  of  the  area  under  ROC  was  described 
by  Green  and  Sv/ets  (1966)  and  its  formula  was  found  in 
Craig  (1979).  | 

P(o,0)  =  F{o,0)/(0+N)  I 
and  '  M 

P(o|0)  =  P{o.O)/P(0)=  F(o,0)/0 

I 

where 

F(**)  is  the  frequency  in  the  designated  cell  of  the  matrix. 

P(\'^)  is  the  joint  probability  of  that  cell. 

i 

  O  -^Jsjhe  number  of  the  old  set  (O).  V 


.   N  *  is  the  number  of  the  new  set  (N). 

(0+N)  is  the  total  number  of  valid  responses. 

z[P{o|N)]        is  the  z-score  of  the  probability  of, 

the  occurrence  of  the  response  old  (o) 
when  the  stimulus  is  (N),  False  Alarm, 


z[P{o|0)l        is  the  z-score  of  the  probability  of  i 
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the  occurrence  of  the  response  old  (o) 

when  the  stimulus  is  (0).  Hit 
P{OJ,  Is  the  a  priori  probability  of  old  ^et  In  the  test  (T) 

P(l\l)  is  the  a  priori  probability  of  new  set  in  the  test  (T) 

A  computer  program  "SIGNALFOR"  was  written  by  the  investigator  in  Fortran 
language  for  the  DEC  10/20  computers  to  calculate  the  above  signal  detection 
measures  for  pictorial  recognition  memory  based  on  the  Yes-No  analysis.  The 
program  calculates  the  sianal  detection  parameters  from  reading  the  subject's  raw 
recognition  data  iiased  upon  the  data  descriptions  in  the  file  "SIGNALDDF".  The 
program  outputs  a  hardcopy  of  the  signal  detection  analysis  report  for  every  subject 
and  a  disk  file  "SIGNALOUT"  to  be  used  in  the  further  statistical  analyses  by  the 
major  statistical  packages  (SPSS,  BMDP,  etc.). 

The  Statistical  Hypotheses 

To  investigate  the  research  questions  of  the  ktudy,  the  SDT  parameters  were 
computed  to  each  subject  in  the  study.   The  three  sign 

and  Aq,  of  the  pictorial  recognition  memory  were  computed.  The  following  null 
statistical  hypotheses  were  tested,  u  (Mue)  is  the  population  mean  in  the^designated 
experimental  condition. 

1.  The  interaction  effect  of  color  modes  and  Imagery  modes   Is   not  ^ 
statistically  significant. 

2.  iJ(Color)  «  p(B&W),  i.e.,  the  main  effect  of  color  is  not  statistically 
significant. 
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3  ^(Photoo'-^phic  Imacjery  ^''^o^le)  =  ^(Diaiti^pcl  WnHgery  Mode),  i  e .  the  main 
effect  of  imagery  modes  is  not  statistically  significant 

4-  Wi*P2*^^3'^4'       ^^^^^  significant  difference  between  the  means 

among  the  four  treatments.  , 

5.  ii(Photographic  Color)  «  ii(Pseudocolor),  i.e.,  the  difference  between  the 
means  of  photographic  color  (realistic)  and  pseudocolor  is  not  statistically 

significant.  .  ^ 

6.  vi(Digitized  B&W  )  «  M(photographic  B&W  ),  i.e.,  the  difference  between  the 
means  of  B/W  photographic  and  digitized^  B&W  is  not  statistjcally 
signsficalit. 

'  7.  ^(digitized  B&W  )  -  y(  Pseudocolor  Digitized),  I.e.,  the  difference  between 
the  means  of  digitized  B&W  and  pseudocolor  digitized  is  not  statistically 
significant. 

8.  ^(photographic  B&W)  »  p(Color  Photographic  ),  I.e.,  the  difference  between  . 
the  means  of  B/W  photographic  and  color  photographic  is  not  statistically 
significfint. 

,  TWO-WAY  ANOVA,  TWO-WAY  ANOVA  (Repeated  Measures)  and  ONE-WAY  ANOVA 
followad-up  by  the  Tukey-B  will  be  used  to  test  the  above  statistical  rjypotheses. 
The  level  of  significance  that  will  be  used  to  reject  or  ret»3n  any  null  hypothesis  will 
be  at  {  0.05  ).  The  Statistical  Package  of  The  Social  Sciences  (SPSS)  and/jr  tha 
Biomedical  Coniputer  Programs  P-Series  (SMDP)  will  be  used  In  the  statistical 

c  .'  .  _  ■  ' 

analysis. 


Findings  and  Results 

The  four  experimental  groups/treatments  were  denoted  as:  Digitized  B&W  (Group' 
1  .1),  Digitized  Pseudo-color  (Group  1.2),  Photographic  B&W  (Group  2.1)  and 
Photographic  Realistic  color  (Group  2.2).  Table  1  shows  the  descriptive  statistics  of 
the  recognition  nnemorv  measures  for  the  four  experimental  groups. 


Table  1:    Means  and  Standard  Deviations  of  the  SDT  Measures  By 

the  Four  Experimental  Groups 


The  Measure 

Group  1.1 

Group  1.2 

Group  2.1 

Group  2.2 

SDT  Detectability,  d' 

Mean 

0.3314 

0.2479 

0.4120 

0.5071  ' 

SD 

0.1079 

0.1634 

0.1839 

0.2697 

Area  Under  ROC,  A' 

Mean 

0.6153 

0.5868 

/  0.6371 

c  0.6596 

•SD 

0.0330  ^ 

0.0528 

0.0520 

0.0731 

Area  Under  ROC,  Aq 

Mean 

0.5644 

0  5481 

0.5788 

0.5968 

SD 

0:0207 

0.0315" 

"  "00351 

0.0513 

/' 
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Testing  The  Statistical  Hypotheses 

The  testing  of  the  statistical  hypotheses  was  carried  over  the  three  pictorial 

/ 

recognition  memory  measures.  The  statistical  analysis  was  consisted  of  two 
statistical  procedures:  two-way  analysis  of  variar.e  and  one-way  analysis  of 
variance.  The  first  three  hypotheses  were  tested  at  once  by  the  two-way  analysis  of 
variance  and  the  last  five  hypotheses  were  tested  at  once  by  the  one-way  analysis  of 
variance  followed-up  by  the  multiple  comparisons  test  of  Tukey-B.  The  four 
experimental  groups'  were  of  the  same  size  (24).  The  F-Test  is  robust  against  the 
violation  of  the  homogeneity  of  vari^iice  when  the  experimental  groups  are  equal  in 
size  {Huck,  1974,  Maisel.  1972).  j 

Testing  Hypothesis  1,  2  and  3 


Table  2  shows  the  summary  of  the  Two-Way  ANOVA  for  d'.  A',  and  Aq  as 

\  •  . 

measures  of  pictorial  recognition  memory. 


The  results  of  testing  hypotheses  were  as  the  following: 

1  Hypothesis  No.l  was  rejected  (d\F=5.283,  df=1.92.  P'0.024;  A'  F=5.244, 
df=1.92.  P-0.024;  Aq  F«=  5.329,  df^l,92,  P=0,023).  This  means  that  the 
interaction  of  color  mcJe  and  the  in^agery  mode  is  significant  at  a-.05. 


2  Hypothesis  No.2  was  retained  (d'  F^0.022-af^T;92rP*0:882r-A-F=0:07V 
df=l,92,  P=0.791;       F=0.013.  af»l,92;P-0.91).  This  means  that  the  mam 
effect  of  color  is  not  significant  at  a=.05. 

3.  Hypothesis  No.3  was  rejected  (d' f-19.\25.  df-1.92,  T-O.OOO;  A'  F-17.995, 
df=l,92.  P=0.000;  Aq  F=18.003,  df=1.92,  P^iO.OOO).  This  means  that  the  mam 
effect  of  imagery  mode  is  significant  at  ar .05. 
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Table  X:    TWO-WAY  Afuilvsis  of  Variance  Siimmarv  For  The  SDT  Detectabilitv 


Measure:  d\  Ihe  area  under  ROC:  A'  and  Aq  ^ 

Source 

SS 

DF 

MS 

F 

Prob. 

The  Measure  d': 

e 

iviaiii  ciicuio^ 

- 

IMMODEfh 

0.693 

1 

0.693 

19.125 

0.000 

cni  ORfc^ 

0,001 

1 

0.001 

0.022 

0.882 

Interaction(lxC) 

0.191 

1 

0.191 

5.283 

0.024 

11^  O.I  U  U  CJ  I 

3.332 

92 

0:036 

Total 

4.217 

95 

0.044 

The  Measure  A': 

M;iin  Ffffict^* 

IVIdlll  L^llwWlO. 

c 

IMMODEfh 

0.054 

1 

0.054 

17.995 

0.000 

COLOR/C^ 

0.000 

1 

0.000 

0.07T 

0.791 

IntPi  ;^^Ti^^^yP^ 

0.U16 

1 

0.01  G 

5.244 

0.024 

0  274 

92 

0.003 

1  otai 

0.004 

The  Measure  A^: 

Main  Effects: 

-IMMODE(I) 

0.024 

1 

0.024 

18.003 

0.000 

COLOR(C) 

0.000 

1 

0.000 

0.013 

0.910 

ln+firact)on(lxC) 

0.007 

1 

n.oo7 

5.329 

0.023 

Residual 

0.122 

92 

0.001 

Total 

0.152  . 

95 

0.002 

1 
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Testinq  Hvpothesis  4.  5.  6  7  and  R 


Tables  3  and  4  show  the  One-Way  ANOVA  summary  and  the  Tukey-B  multiple 
comparison  test  for  d\  A'  and  Aq.  The  results  of  the  tests  of  the  statistical 
hypothesis  4,  5,  6,  7  and  8  are  as  the  following:    .  \ 

1.  Hypothesis  No.4  was  rejected  (d'  F=8.143,  df=3i2,  P=0.0001;  A'  F=777a  , 
df=3,92,  P=0.0001;  Aq  F«7781,  df^3,92,  P=0.000li.    This  means  that  the 
differences   among   the    means    of   the   four   treatment    groups  are 
statistically  significant  at  a=.05. 

2.  Hypothesis  No.5  was  rejected.  The  two  treatment  groups  do  not  fall  in 
one  homogeneous  subset  at  a=  05,  see  Table  4.  This  means  that  there  is 
a  significant  difference  between  the  photo  realistic  color  and  the  digital 
pseudo^color. 

3.  Hypothesis  No.6  was  retained.  The  two  treatment  groups  fall  in  one 
homogeneous  subset  at  a=05,  see  Table  4.  This  means  ^at  there  is  no 
significant  difference  between  digitized  B8tW  and  the  photographic  B&W 
treatments.  ' 

4.  Hypotliesis  No.7  was  retained.  The  two  treatment  groups  fail  in  one 
homogeneous  subset  at  a=.05,  see  Table  4.  This  means  that  there  is  no 
significant  difference  between  the  digitized  B&W  and  the  digitized 
pseudo-color  treatments. 

i.  Hypothesis  No.8  was  retained.  The  two  treatments  fall  in  one 
homogeneous  subset  at  a=.05,  see  Table  4.  This  means'  that  there  is  no 
significant  difference  between  the  photographic  B&W  and  the  photo 
realistic  color  treatments.  _   
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Table  3:    ONE-WAY  Analysis  of  Vfiriahce  Summarv  For  The  SDT  detectabllitv  Measure 

d'.  the  area  under  the  ROC  A'  and  Aq 


Source  ■  DF  MS  F    :  Prob. 


The  Measure  d': 

Between  Groups  ^  0.8848  3  0.2949  8.143  0.0001 

Within  Groups  3.3323  92  0.0362 

Total  4.2171  95  ' 

♦ 

The  Measure  A': 

Between  Gioups  0.0695  3  0.0232  7.770  0.0001 

Within  Groups  0.2744  92       ;  0.0030 

Total  0.3439  95 

The  Measure  A^^: 

Between  Groups  0.0308  3  0.0103  .7  781  0.0001 

Within  Groups  0.1216  92  0.0013 

Total  d.\1524  95 
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The  SDT  detectabilily  Measure:  d\  the  area  under  ROC  A'  and  Aq 


The  Measure  d': 
Experimental  Group 
Sorted  Means 
Homogeneous  Subset  1 
Homogeneous  Subset  2 
Homogeneous  Subset  3 
The  Measure  A': 
Experimental  Group 
Sorted  Means 
Homogeneous  Subset  1 
Homogeneous  Subset  2 
Homogeneous  Subset  3 
The  Measure  A^: 
Experimental  Group 
Sorted  Means 


Homogeneous  Subset  1 
Homogeneous  Subset  2 
Homogeneous  Subset  J 


Group  1.2      Group  1.1      Group  2.1 
0.2479  0.3314  0.4120 


Group  2.2 
0.5071 


Group  1-2      Group  1.1      Group  2.1      Group  2.2 
0.5868  0.6153  0.6371  0.6596 


Group  1.2      Group  1.1      Group  2.1      Group  2.2 
0.5431  0.5644  0.5788  0.5968 
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Discussion  and  Conclusions 

Findings  of  the  study  suggest  that  the  use  of  the  digitized  B&W  images  in 
computerized  instruction  and  information  .  transmission  of  pictorlai  information 
provides  the  same  pictorial  information  as  of  the  photographic  B&W  pictures.  This  is 
based  on  the  lack  of  significance  of  the  difference  between  the  photographic  B&W 
and  the  digitized  B&W.  This  could  be  interpreted  as  that  the  change  of  the  mode  of 
pictures  from  photographic  to  digitized  form  does  not  change  the  features  that  the 
human  viewers  need  to  recognize  these  pictures.  This  conclusion  is  important  in  the 
design  of  visual  learning  in.  future  developments  in  computer  based  visual  learning 
systems  by  constructinij  pictoria!  banks  or  pictorial  data  basn  .  '  naturalistic  scenes 
that  could  be  retrieved  for  learnihg  and  instruction. 

It  was  expected,  in  view  of  the  cue-summation  theorv  of  !«sm  <ig.  that  ad^Jing 
pseudo-color  to  the  digitized  B&W  images  would  increati  thQ  C,;>  .nctiveness  and 
recognition  of  these  pictures  in  the  task,  the  Jack  of  the  -  ..cance  between  the 
digitized  B&W  and  the  digitized  pseudo-color  could  be  because  of  the  use  of  onu 
pseudocolor  method.  So,  this  result  should  be  iirnitetf-io-tha  case  of  using  one 
pseudocolor  method.  Using  one  pseudo-color  method  could  have  made  the  picJwes 
r.avo  much  the  same  of  their  color  look.  TtMs  may  suggest  that  the  use  of  more  «5:  .1 
000  pseudocolor  method  (color  tables)  and  adjuating  these  color  methods  could  m^ike 
the  picture  more  distinctive  and  recognizable  than  its  digitized  B&W  counterpart.  It 
should  be  nctl^tiwt  the^seuodcol^ (single  method)  ts  different  thtn  the  non- 
Teatistic  CDtor-in-other-studies-(Berryr-l977-1982;-Lertchalo!arn,1981).~  The-non-^ 
realistic  color  (NRC)  used  In  those  studlesiwas  based  on  the  origJnal  picture  realistic 
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color  complements  wliich  ;»rp  morn  'i.isiinrUve  from  on  ^  picru^  t^  rp  another  In  view 
of  this  study's  findirigs  and  the  other  research  on  color  realism,  the  digitized 
pseudocolor  could  be  more  effective  in  learning  and  ii^structlon  if  it  is  used 
purposefully  in  multiple  methods  and  adjusting  them  to  eerh  picture  to  make  them 
more  suitable  to  the  objectives  of  the  learning  task. 

The  result  that  there  is  no  significance  in  the  differorrc:^  between  th<j  fihotographic, 
B&W  and  the  photographic  realistic  color  supports  simiSar  r)ndin^i?  JMyatt,  1974).^ 
However,  this  doesn't  support  other  studies  (Berry,  ^377,  lV(3ckowskl,  1979; 
Lertchalolarn,  1981).  This  could  be  interpreted  by  the  view  tf^at  tho  realistic  scenes 
need  more  processing  time  than  the  black  and  whcte  which  Is  not  given  in 
recognition  experiments  since  the  acquisition  time  cf  old  pictures  is  always 
around  500ms.  "  ^  . 

With  regard  to  the  finding  ihat  the  photographic  realistic  color  is  significantly 
different  than  the  digitized  pseudocolor,  tliisi  folding  could  be  Interpreted  by  the 
contention  of  the  realism  theories.  So,  this  concludes  that  the  realistic  color  is 
preferred  more  thin  tjrgltiMd"pseiidocolor  in  learning  from  realistic  scenes. 

The  findings  of  tfiis  study  partially  suppo't  the  contention  of  realism  theories.  The 
cue-summation  theory  was  not  supported  by  any  of  the  findings.    However,  both 

reaUsm  thVories  Im^  thT~c^ 

of  the  significanca  of  the  difference  between  the  digitized  B&W  and  the  digitized 
pseudocolor  and  also-the^)hotogr^phic  B&W-and-the  photographiC-realistic  _color^__^ — 

The  approach  of  modeling  the  pictorial  recognition  by  the  signal  detection  theory 


and  Ihe  use  of  rhe  oarninplPis  d*  A'  and  Aq  to  measure  rhe  re(.:oanitton .  nrnce 


•  should  be  considered  for  accuracy  analysis  of  recognition  data.  These  three 
measures  were  consistent  in  all  the  decisions  involved  in  testing  the  eight 
hypotheses  of  this  study.  The  ne\y  parameters  A'  and  Aq  are  accurate  alternative 
distribution-free  measures  of  recognition  memory.  It  is  suggested.in  view  of  the 
findings  of  this  study,  that  the  parameters  A'  and  Aq  should  be  used  when  the 
experimenter  is  in  doubt  of  the  parametric  assumptions  of  the  parametric  measure  of 
detectability  (d'). 


Based  on  the  findings  and  the  above  discussions,  some  conclusions  and 
recommendations  could  be  drawn: 

1.  The  signal  detection  theor/  fSDT)  parameters  of  Yes-No  experiments,  d', 
and  Aq  are  consistent  and  should  be  used  for  accuracy  analysis  of  the 
recognition  data. 

2.  The  two  distribution-free  SDT  parameters  of  the  area  under  the  ROC 
curve.  A'  ancj  Aq  offer  the  same  accuracy  of  the  d'  (SDT  index-  of 
detectability)  In  analysing  recognition  data.  A'  and  Aq  should  be  used  If 
the  experimenter  Is  in  doubt  of  the  distributional  assumptions  of  the 
parametric  measure  d*. 

3.  Pseudocolor  methods  should  be  used  in  digital  images  with  adjustment  to 
each  Imnfje  to  meet  the  purpose  of  malcing  the  picture  suitable  to  the 
learning  task.  In  recognition  and  detection,  various  pseudocolor  methods 
should  be  used,  not  just  one  color  table.  ' 

4.  The  digitized  B&W  Images  could  be  used  in  learning  at  the  same  effect  of 
the  photographic  B&W  pictures.    This  conclusion  could  be  applied  to 

 siipport  any  computerized  visual  learning  system  to  use  pictorial  data 

bases  and  also  support  the  computerized  sllde-^maklng  for  learning  and 
presentation  of  information. 

5.  The  main  effect  of  color  Is  not  significant,  but  the  main  effect  of  the 
imagei^  modeH^  fesliltltha^^^ 

significant,  the  effect  of  these  two  factors  Is  not  additive.  On  the 
contrary,   these   two  factors   systematically   Interact   and   affect  the 


rftcounirinn  Tliis  siuiciosis  rhar  \\u\  itUer;w:licin  of  the  two  factors  should 
be  considered  in  the  mlerpretalioo  nod  design  of  pictorial  learning  in  such 
tasks,  » 

6.  The  contention  of  realism  theories  is  partially  supported  while  ^the  cue- 
summation  theory  is  not  supported.  However,  both  of  these  theories  are 
not  suitable  to  interpret  the  zero  effect  of  color  in  both  the  two  imagery 
modes. 

7.  The  failure  of  the  applicability  of  both  the  two  contentions  of  of  realism 
theories  and  the  cue-sumnriation  theory  should  be  attributed  to  the 
learner  variables  more  than  to  the  pictorial  design  and  attributes. 

8.  The  above  conclusion  supports  the  view  that  learner  variables  should  be 
also  considered  in  the  interprejtation  and  design  of  learning  tasks.  Learner 
variables  such  as  learning  and  thinking  styles,  cognitive  styles,  and  other 
personality  traits  should  be  considered  in  the  design  and  interpretations 
of  recognition  and  learning.  This  suggests  follow-up  studies  or  new 
studies  that  take  into  consideration  the  learner  variables  irt  the  learning 
process. 
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Visual   Attention  to  Picture  and  Nord  Material 5_as f  1  uenc e^^^  by 
Characteristics  of  the  Lear^ners  and  Desi  gn_Qf_thg^  Mater  i^^^ 

Purpose,     The  long  range  goal   of  this  program  of  research  is  to 
improve  the  match  between  the  design  of  i nstruct i onal  materials 
and  the  characteristics  of  learners.     Particular  attention  is  on 
the  cognitive  strategies  v^hich  skilled  learners  employ  in  the 
study  of  materials  combining  words* and  pi ctures.  . 

Theoretical   interest  centers  on  the  fact  that  recent 
research  on  verbal   and  imaginal   processing  suggests  that  words 
£^nd  pictures  are  cognitively  disparate^,   requiring  different  kinds 
and  amounts,  of  processing-  -  This  implies  potential  cognitive 
problems  where  words  and  pictures  are  mi>;ed  i  ndi  scri,mi  nately  in 
instructional  materials- 

^     What  follows  was  an  e>:  pi  oratory  study  of  how  skilled 
learners  cope  with  materials  combining  words  and  pictures,  e.g., 
textbooks.  '  ^  . 

Background.      This  study  was  done  in  a  framework  of  cognitive 
theory.      It  specifically  examined  the  eye  movements  of  learners 
studying  print  materials  combining  te>;t  and  illustrations.  The 
eye-movement  patterns  were  seen  as  useful   indicators  of  the 
cognitive  strategies  employed.      (There  is  ample  precedent  for 
this  interpretation  of  eye-movement  data,   e.g..   Snow,    1968;   Jui»t  . 
and  Carpenter,    1980;   Farnham-Di ggery  and  Gregg,    1975)  Strategies 
were  inferred  from  the  differential  duration  of   attention  to  word 
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and  picture  areas  and  from  the  numbers  and  pa'tterns  of 
transitions  between  areas. 

\ 

The  writer  ascribes  to  a  construct! vi st  model   of  reading, 
where  reading  comprehension  involves  the  reader^'^  search  for 
meaning  from  the  author's  words  as  well   as  hi  s  di  agr  an^s,  grrphs, 
pictuf-es5   etc.     Meaning  is  constructed 'by  the  reader  both  from 
what  the  material   provides  and  what  the  reader  provides  from 
his/her  own  world  knowledge.     The  skilled   <uni versi ty-1 evel ) 
reader's  pri or  knowledge  includes  strategi es  for  studying  and 
schema  for  i^nterpreti ng  and  remembering  various  kinds  of 
materials.,   e.g.  5   stor  i  es,   e>:ppsi  tory  text ,   research  articles, 
science  diagrams,   pictorial   scenes,  etc. 

Research  to  date  on  reading  comprehension  has  examined 
primarily  the  words   (prose  1 earni rig ) ,   to  a  lesser  extent  the 
illustration's   (picture  learning),    and  rarely  both  in  interaction 
(textbook  learning).     This  both  explains  the  preponer ance  of 
prose  learning  concepts  in  what  follows  and  justifies  the  current 
study  of  strategies  involving  both  text  and  illustration. 

^      .      ■       ■        ■  i 

Much  ha^  been  made  of  the  differences  bet  ^^een  word 
processing    (linear,   digital,    symbolic,    left  brain,   visual  and 
auditory  modalities,    learned  skill)    and  picture  processing 
(simultaneous,    analogic,   concrete,   right  brain,   visual  modality, 
less  learning}.     Clearly  there  are  processes  speci-fic  to  eachj 
but  on  a  typical   page  combining  both  they  must  somehow  be 
integrated-     A  macrostructure   <theme,   gist)   must  be  constructed 
that  includes  both.     Ap^^Sntly,   these  diverse  elements  are 
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integrated  primarily  at  a  higher  semantic  level- 

Reading  theories  differ  in  degree  of  emphasi s  on"  what 
■information  is  given  in  the  text  as  compared  to  what  is  brought 
to  it  by  the  reader.     Those  emphasising  meani ng-i n-the-te>: t  are 
remindful  of  the  position  of  many  audiovisual  "professionals, 
i.e.,   the  meaning  is  in  the  medium,   especially  the  pictures. 
Both  emphasise  the  given  stimulus,   whether  word  or  picture.  In 
contrast,   the  reading  construct i vi st  theories  which  emphasise  the 
interaction  of  reader  characteristics,   context,   and  print  are 
remindful   of  the  aptitude   (or  trait)   treatment  interaction 
theorists  in  instructional   development.     ^oth  emphasise  the, 
differential   outcomes  from  what's  given  depending  on  the 
learner's  prior  knowledge,    interests,   skills,  etc. 

The  above  suggests  the  two  sets  of  pertinent  variables  which 
this  study  investigated,    i.e.,   what's  given   (design  variables) 
and  what  the  learner  brings  to  it    (learner  vari ables) .     One  of 
the  design  variables   (what's  given)   often  cited  in  reading 
comprehension  research  is  context,    i.e.,   the  verbal   context  on 
the  page.      In  the  present  analysis  of  realworld  instructional 
materials  it  is  apparent  that  words  in  textbooks  often  provide 
context  for  pictures,   e.g.,   interpretive  captions,   and  pictures 
often  provide  context  for  worcJs,   e.g.,   pictured  examples  o\ 
concepts.     Often  the  intended  relation  between  text  and 
illustration  appear s ' ambi guous.     Where  one  appears  above  the 
other  on  a  page,   do  readers  assume  that  the  one  provides  a 
context  for  what  follows?     The  questi on  of ' page-1 ayout  order, 
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i.e.,   which  comes  first,   words  or  pictures,   was  examined  in  this 
study.     Different  cognitive  strategies  were  expected  for  the  two 
page-layouts,   WP  and  PW,   but  the  direction  of  those  differences 
was  not  predicted-  c 

Another  of  the  design  variables  common  in  reading  research, 
is  complexity,   which  is  often  operati on&l i zed  according  to  a- 
readability  formula "involving  word  length  or  frequency,  sentence 
length,   etc.     Complexity  has^lso  been  variously  operationalized 
in  picture  studies  by  number  of  figures,   degree  of  realism,  etc. 
In  this  study  complexity  was  operationalized  in  two  ways:  grades* 
level   of  the  materials  and  length  of  sentences.      It  was  predicted' 
that  cognitive  strategies  for  comp\-ex  materials  would  include 
longer  study  durations  and  more  transitions  between  areas  than 
for  simple  materials.  • 

'      Common  measures  of  learner  characteristics  in  reading 
studies  are  proficiency  tests,   e.g.,   vocabulary  or  .  , 

comprehension.     The  present  study  using  graduate  students  assumed^, 
high  reading  and  study  skills.     However,   the  sample  was  divided 
by  sex  because  it  was  hypothesized  that  word/picture  study 
strategies  of  males  and  females  might  differ.     The  evidence  that 
women  tend  to  have  higher  verbal   skills   <Lips  and  Colwill,    1978)  ^ 
as  well   as  higher  grades  in  general    (Maccoby  and  Jacklin,    1974)    .  , 
was  the  basis  for  predictions  of  greater  attention  to  words  and  . 
longer  over al 1 ' study  duration  for  women  than  men.  •  - 

Anottper  learner  characteristic  studied  here  was  cognitive 
'  style,   specifically  field  dependence-field  i ndepc-^ndence.  Thp 
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evidence  that  field  dependents  tend  to  be  n>c.  e  global   and  field  ^ 
independents  more  analytical    (Witkin,   et  al ,    1974)    led  to  the 
prediction  that  global   field  dependents  would  follow  (te 
dependent  on)   the  given  pattern  of  information  on  the  page, 
whereas  the  more  analytical   field  independents  would  tend  to 
deviate  from   (be  independent  of)   the  given  pattern. 

World  knowledge  is  considered  to  be  an  important  factor  in 
reading  comprehension.      In  the  present  -^tudy  an  at^iempt  was  made 
to  estimate  the  prior  knowledge  of  the  1  earners  about .the . sub ject 
matter,   biological   science.      It  was  predi cled  . that  the  more 
knowledgeable  learners  would  have  study  strategies  which  were 
shorter  in  duration  and  which  involved  fewer  transitions  between  . 
•areas  than  would  less  knowledgeable  learners. 

J, 

Procedure.     A  convenie-nce  sample  of  24  students  was  selected  from 
a  graduate  class  in  Education  such  that  half -were  males. and  half 
females.  Half  of  each  sex  grouping  were  randomly  assigned  to  each 
of  two  page-layout  treatments. 

The  design  variables  were  complexity  at  two  levels,  simple 
v.s.   complex,   and  page  layout  at  two  levels,   picture^irst  and 
then  words   <PW)   v-s.   wor-ds  first  then  picture   (WP)  .     See  Fig.  1 
for  an  example  of  a  PW  layout.     The  simple  material   was  from  an 
'8th  grade  text,   while  the  complex  was  from  a  scientific  research 
journal.     They  contained  comparable  numbers  of  words,  but 
•    sentences  in  the  complex  material   averaged  about  t^ice  as  long. 
The  learner  variables  were  sex,   cognitive  style  (field 

■  lb8   
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I  lii  2  The  rancr  of  httiint  in  M4  »ri»4m.  Ihg  rrc«{ucm:>  Bnr  h  drawn  Uif*ti/hnfku^y,  fc»ro  «rru  Hcnx 
,1141.  ihruugh  ThTwifwinund  and  icrwiMallng  in  ih*  uhr«uund  «  I00.1KW  11.  |IW>  kKitl  L.,w  ^rv^f*cmy 
uin.uii  arc  detcocd  bv  (he  criclrf.  rtrci  ami  hijher  lrc«,ucnci«  are  drtccied  U  m>  .vmpaitti  orpn  «r  «ir. 
nrU.w  the  frciiueficy  line  are  drawn  nypical  MHircct  iif  wHind  that  faS  wuhm  ihe  cmkcs  »  raiiK  :>T  audiiMwu. 
•crrt^rial  prcdaiuri  sue?!  a»  frup  prGuce  km  frcHuency  *ibra««n..  cr«cict.  pr.«l«ce  enidilk  fr«|u««y 
vihfai4«»nf.  and  flyinj  hau  produce  iilira*u«nd. 

Ktcor.Ni/.iNC  rmnAtoRs  »v  F>r:  -jimncS-pyiiaes-are-conipt^aefiJ  of-^O  kHi- 

Tmk  PiT«:ii  Is  THi  S^viTCH  loiies.  shc?  cr^.cV>?t*s  abdiimcn  and  legs 

In  \t%  world  a  rrii  Ui  liwir*  niii  only  iHh-  abruptly  vcct  t«»  iise  righi;  in  frcc  flighi  ihU 

cr  crkicw.  ii  licars  mrtcnrijil  iimlaiors.  -  >Mld  |i.ropifl  ih«f  itk  U-i  atvay  from  ihc 

Ci  ickcu  arc  sensitive  u»  a  snrprisingly  %v5dr  ^mnd  source.  Thus, »  kHz  loncs  dicji 

ranijc  of  frcnuentics;  in  fact,  ihc  l?«|uciv  Stivr  phonowtiic  m^vcnitnis  and  40  kHz 


iiic  iiiscvi  >  -u«..w. .  opabiliiies.  F ^gurt  _  - 

sho*vs  a  frequency  range  frons  zero  Hz  lo  qnency  of  ehe  calhng  s«»ng  j^f  Tr/r«mfftj 

100  000  Hz—from  infrasound  lo  ulira-  ofeaninai  icmalc  crickeu  are  aiiraacc?  to 

sound.  Crickets  are  sensitive  over  a  good  this  frequency.  Forty  kHz    in  the  ultra- 

pan  of  this  range:  compare  this  »vith  the  sonic  range  and  occurs  in  the  vocalizaisuns 

audiion- sensitivity  of  humans.  *vhich  spans  produced  by  insectivorous  bats  (Cr^Tin. 

a  ranee  of  50  Hz  to  15.000  Hz.  i  W);  crickets  attempting  to  escape  from 

nKure3A-C$hi««  diagrams  taken  from  ecbolucating  bats  would  be  expected  tv 

phiJtographs  of  nniig  crickets  rcspimdtng  repel  to  40  kHz  aversively. 

In  acoustic  stimuli!  In  the  abscrtce  of  sound  The  frejiuenQiscnsuiyit)r^^^ 

 acrickct  flics  with  asvmmeiricalllighi  pos-  hi  v.or  can  be  ascertained  by  esamintng  a 

?ure.  Hith  its  longiuHlinal  biKly  a5is  per-  I-  :havioral  tuning  cur^v  (Fig.  3D)  made  by 

fcctly  straight.  When  a  scries  of  sound  measuring  the  threshold  sound  intensiti.^ 

pulsL  consisting  of  pure  ff  kHz  lunci  h  rcniuiied  to  elicit  a  phonotartic  responses. 

Slaved  from  a  sScakcV  on  the  cricket^s  lef  ;  a  function  of  the  ume  frc|ucnc>-.T.  ocm:^- 

he  in'ea  bcndViu  iUhimen  and  legs  %o  ina  is  most  responsive  to  tones  m  the  range 

the  tef^a  ridder-like  aaion  that  ?ould  4-6  kHz.  with  peak  sensitivity  at,5  kHz:  a 
propel  .he  insect  tou^rd  the  speaker,  were  l«»ondarea  of  semitivjt^ 

O  "he-Ssecl  nwteth^rHo*^^  I 


-  dependent-/-f-i  el  d--i-ndependent)-,--and-pi^i  or--knp   

The  dependent  variable  was  visual   attention  as  indicated  by 
eye-movement  data,   specifically  the  amount  of  time  spent 
attending  to  each  area  of  the  materi al s   (durati on)V  the  number  of 

shifts  between  are4s   (transitions) ,   and  tne  pattern  of   

transitions   (sequences) - 

Sub  jects  were  instructed  to  study  the  materi  e,l   as  though  it 
had  been  assigned  for  them  to  understand  and  remember.     They  were 
then  fitted  with  head-mounted  ojye-movement-detect ^ ng  equipment  \^ 
(NAC  Eyemark   IV).     They  were  allowed  as  much  time  as  needed  to 
study  the  materials.'  • 

" Sut3  jecti"~then c"^mpl  itid~a"b"ri^"que¥R"onr^^^    concernTng-  t>i 
relative  familiarity  and  difficulty  of  the  m.  :eri£is  and- the 
number  of  related  courses   (biology)   which  they  had  taken.  They 
then  took  a  cognitive  style  test,   the  GEFT   (Gr'  up  fcmbedded 
Figures  Test). 

Raw  data  records  consisted  of  videotape  recordings  showing 
the  stimulus  a  subject  was  studying  plus  a  superimwOsed  marker 
which  indicated  just  where  on  the  stimulus  the  subject  wac- 
looking  at  any  moment.  ^  The  four  pages  of   stimuli   were  divided 
—      into -30  signif  i  cant  areas,   i  .  e.  ^  eitHer  f  igures  inTthe  picturc-^^ 
or  captions  and  paragraphs  in  the  text.     Read  out  from  the  


videotape  records  were  the  duration  of  attention  to  each  area  and 
\    the  number  and  sequence  of  transitions  between  -areas.  ■  Twenty  of 


the  24  records  were  usabl^?.  _  y 

 — 
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'Result&:  Overal  1 A  Sex  and-.LayDUt_ 


(independent  measures)   and  Complexity   (repeated  measure)  on  total 
transitions  revealed  the  predicted  signficant  main  effect  for 
complexity,   p<.  001,  -but  no  effect  for  sex  or  layout.  Subjects 
made  more  transitions  in  studying  the  complex  material   than  the 
simpl e. 

Analysis  of  the  effects  on  total   duration  revealed 
significant  differences,   as  expected,   for  both  sex,   p<.004,  and 
complexity,   p<.001.     Fe/nal  es  attended  longer  overall  to  the  study 
materials  than  did  males.     All   subjects  studied  the  complex 
materials  more  than  the  simple. 

There  was  no  main  effect  for  layout   <P.W  v.s.  WP> 


prior  knowledge.     Analyses  of  the  data  relative  to  familiarity  of 
thB3.content  as  well   as  number  of  bi  ol  ogy  courses  ta^^en  reveal  ed 
no  significant  relationships  to  cognitive  strategy. 

There  was  a  significant  positive  correlation  between 
cognitive  style   (GEFT)   and  number  of  transitions,  for  complex 
materials  only   (Spearman  p<.034.   Kendall   p<.037).     So,   a  median 
split  was  made  of  the  subjects  by  GEFT  score  and  two  groups- 
formed,   higher  scorers   (Field  Independents)   and  1 ower /scorers 
(Field  Dependents).     An  .ANOVA  rev£?aled  a  significant  two-way; 
interaction  between  cognitive  style  and  complexity,  p<. 003,  for 
transitions.     Whi  lll"sub  jects"~Df"~both  cognTti've  styi  es~m^cre--~fflDrB 
transitions  on  complex  materials  than  on  simple,   the  field 
independents  made  a  larger  adjustment  to  complexity,   i.d.  they 
 -made--i^&l-atijv-,&lJ/--^^^  t he^impl  e  and  relatively  
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more  transiti  DPS  for  the  cDmple>:  materials  than  did  the  field  - 
dependents.   See  Fig.   2.  ,  ' 

Results;  Comple>;  Material.     Because  subjects'   strategies  seemed 
Wst  influenced  by  the  complexity  factor,   it  was  decided  to 
analyze  the  most  complex  page  further.     A  3-way  ANOVA,  Page 
Layout  by  Se>:  by  Sequence,   revealed  a  significant  main  effect  for 
sequence,   p<.05.     There  were,   of  course,   more  transitions  in  the 
given  sequence   <top  down)   than -in  the  reversed.     However,   there  ^ 
was  a  significant  2-way  interaction  between  sex   and  sequence, 
p<.05,   the  females  favo|ing  the  given  order  and  the  males  the  . 
reversed.     This  was  further  modified  by  a  3-way  interaction 
involving  page  layout,   which  revealed  that  the  ^^"dency  for  ^m^.l  es^ 
to  make  more  reverse  order  transitions  was  limited  to  the  WP 
layout  condition    (words  first,   then  pictures);     See  Fig, 


The  above  interactions  suggest  a  very  intei  3sting 
possibility.     Assume  ti.at  a  compatible  matcn  of  cognitive 
strategy  and  page  layout  would  show  up  as  a  largely  straight 
through    < top  down)    attention  sequence,  i.e.,   a  minimum  number  of 
transitions  and  most  of  these  in  the  given  order.      It  follows, 
according  to  this  assumption,   that  the  most  compatible  layout  for 
males  was  PW  and  for  f emal ■ s  WP.     See  Fig.   3  for  the  curves  with 
a  low  overall   number  of  transitions  and  with  more  in  the  given 

_  
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A  further  analysis  was  ma.de  of  attention  patlferns  to  the 
five  pictorial   areas,   two  rel  ated,  verbal   areas,    and  one  caption 

—   :  -172     : 


18; 


r 


\00  1 


i 


acea  on  the  complex  page-     A  2-way  ANDVA,   Se;:  by  Layout,  revealed 
no  differences  in  attention  to  picture  areas  but  a  significant 
difference  in  attention  to  verbal   areas,   p<.05.     As  predicted, 

women  made  more  transitions  to  verbal   areas  and  maintained 

t 

attention  there  longer  than  males-     For  the  caption  ar.ea  there 

/ 

was  a  significant  effect  for.  layout,   there  being  more  transitions 
to  the  caption,   p<.01,   and   longer  durations  on  the  caption, 
p<.05,   for  the  PW  layout  than  for  the  WP  layout.     This  is 
understandable  because  the  PW  layout  put  the  caption  in  the 
middle  of  the  page  where  it  was  more  noticeable,   whereas  the  WP 
layout  put   it  at  the  bottom. 

Another  analysis  of  the  complex  page.   Cognitive  Style  by^ 
Layout,   revealed  no  differences  for  the  verbal   areas  but 
significant  diVferences  for  pictorial   areas,   p<..05  for  durations 
and  p<.01   for  transitions.     Field  independents  looked  longer  and 
more  often  at  picture  areas  on  the  complex  page  than  did  f.^eld 

'dependents.     This  was  not  predicted. 

.  .  \    '■-        ■  «■ 

..   •  \ 

Conclusions.     Of  the  desi gn  var i abl es,   the  complexity  factor  was 
clearly  the  most  determinative  of   learner  strategy.     Of  the 
learner  variables,   prior  knowledge  had  no  effect  on  strategy. 
Perhaps  the  measures  of  prior   knowl edge^ were  inadequate.  The 
other  l^^ner  variables,   cognitive  style  and  sex,   were  reliably 
associated  with  learner  strategies. 


These  main  effects  and  interactions  with  cognitive  style  and 

f-     sex  were  largely  as  predicted  from  prior  research  and  theory. 

175  . 


HowBverj,   there  were  some  surprises,   e-g.,   the  effect  of  cognitive 
stylecon  strategy  adaptation  to  instructional  material 
complexity,   and  the  effect  of  sex  on  strategies  for  sequencing  ; 
attention  to  words  and  pictures. 

\ 

Clearly,   more  such  studies  are  needed  to  confirm  or 
disconfirm  these  conclusions.     However,   the  results  do  suggest 
that  the  design  of  science  materials  for  graduate  students  may 
need  to  take  account  of  two  learner  variables,   sex   and  cognitive 
style,   and  two  design  variables,   complexity  and  picture-word 
layout. 
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.  ABSTRACT  :  ^ 

The  suDDlantation  approach  of  this  study  hypothesized  that  media 
IttribStes  may  serve  to  bridge  the  processing  link  ^etween  learner 
p^tttude  capacity  and  the  demands  of  a  concept  attainment  task.  ■  The 
«?uiv  utilised  a  treatment-by-blocks  design.     The  aptitude  block  was 
composed  of  ^volevetsT    extLme  field-independent-  individuals  and 
ext?emrfield-dependent  individuals..   Three  treatment  variables 
comMned  to  f orm^eight  treatments .    Each  treatment  f ^^^^^^^J^^f 

xcolor  -  or  non-coXol  -  cueing,  plus  simple  or  complex  line-drawings 
Accompanied  by  either  an  inductive  or  a  deductive  verbal 
presentation.     Tbese  treatments,  were  se.lected 

nronosed  suDfc  latitat  ion  value  to  increase  the  salience  of  relevant 
?oSSepf  atSibutes.    A^  of  variance  revealed  interactions  which 

suggested  that  treatments  were  differentially  effective  in  meeting 
thf differing  task  requirements  of  a  transfer  and  a  non-transfer 
posttest  meafure.     Findings  may  be  of  interest  to  those  in  ^ 
instructional/training  settings  in  which  learners  are  required  to 
t?lnlfer  learning  from  a  technical  line-drawing  presentation  to  a 
real  object. 
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APTITUDE ^SENSITIVE  INSTRUCTION: 
THE  :ROLE  OF  MEDIA  ATTRIBUTES  IN  OPTIMIZING 

TRANSFER  OF  TRAINING 

The  power  of  media  to"  Influence  our  values  opinions  and  a^^^ 
confronts  us  whenever  we  turn  on  '^e  television  or  ogen  | 
Many  training/educational  IJ^terlala  ^^^^J^l^a  in  tSia  paper 

instructional  advantage.    The  ftuay  to       "  .     j^^ggj,  upon 

argues  that  "ecfflc  con?inatIo^^  of  meSla 

I???"ut""SavI^n*'the"?nte4afps^ 
operaticns  o£  learners. 

■  •  ^ 

.  RATIONALE  AND  PURPOSE 

7 

The  Role  of  Media  Attributes 

Situations.    Because  much  instruction  "  P^^^  interest  in  how  best  to 

refirn^eS'l  "S^-^"-'"^^^^^^^^^^^  ""^  " 

instructional  modules  which  teach^ concepts . 

A  frequent  decision  f-ing  the  instructiona^ 
selection  of  a  way  to  present  ^he  instructional  mg^^^^^ 
effectively  for  all  learners,  ^^his  proDiem  oi  instructional 
raised  continuing  concern  ^"jo^g^^^^^^^^^^^^nal  philosophy  today 
designers  and  classroom  teachers.    Educational  PJJ^°^j^^    ^ea^s  of 
placis  emphasis  upon  ^oth  the  need  to  consider  alter alternatives 
providing  instruction    and  the  need       choose^ trom^    learning  (cf. 
on  the  basis,  of  criteria  which  ^{D^^^^'^^H  HHls  the  need  fSr 
Cronbach  8.  Snow,  1977;  Salomon    1979).    This  r^^^  ^^^^^^^ 

sound  criteria  upon  which  to  base  ^^^^"^^"t it loners  prefer  to  rely 
Kieslar  (1977)  have  observed  tha^  most  P^^^tj^^^^l^  ^o  researchers 

?irirnri97?t^?if  rif  3^^^^^^^^^^ 

Several  writers  have  noted  ^^at  hundreds  ptsc  another  medium 

compared  the  effect  of  one        J^J.^^^J^flompa^ed  (Chute,  1979;. 
without  carefully  i973;  Salomon^and  Clark,  1977; 

ll^^sU]'llh)r'^^^^^^  comparisons  has  be.n 
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termed  "reaearch  with  .edia"  f -l°"f^       ,  :      ^i„i?'l^it^d  UtUe  to' 
realization  that  gross  media  comparJ     ..    '  ,  f„  „ore 

1974.  1977).    These  authors  have  suggest         lat  a  P^°°"^^?;^^t 

as  modes  of  stimulus  presentation.     Salomonjjnd  Clark  referred  to 
this  different  research  focus  as  "rese-rcb  on  media     Ciy//»  P*.„ 
cnxs  aiiieteuL.  ,       oi-<-r4 Vint^R  oi  rctfla  may  be  defined  in 

l%SroriLI^^|ly  h^log?ca?^rfSc  faSi  InSructLnal  eff^^^ 

attributes  of  media  or^ technology  have  ^.^^f^  P^f  ^^^Ij^Lf  They 

:,S!valents.    This  approach  is  "2^^ '"^ich  has°IIso'criled 
Irecmcati°oS"or'ei°perreiL!Ta?faSie:  (Cron^^^^^^^ 

reievauL.  auui.  j-urta^.^  ^4i-FoT-*»n^  Iparners  under  specif  led  tasK 

^onSiriSntrToth  Cro°nLchl!l7?)  ^ndTalomon  (197?)  have  called  for 
??sea"h  that  is  theoretically  based  to  develop  explanatory 
S?inciples  that  may  function  as  "skeleton  hypotheses"  (Salomon,  1979, 
p!  12)  to  which  numerous  practical  Instances  could  apply. 

Thus    a  new  set  of  research  assumptions  may  be  applied  to  the  ^ole  of 
I^H?:  in  inst?ucti6n.     The  most  important  difference  to  those  of  past 
?etearcS  i^thTedl^is  that  research  on^media  ^^-^f .^P-^^y.^^^?!?"^ 
"  variables  in  terms  of  attributes  of  melia  which  relate^to  learners 

dimensions  of  media. 

The  attributes  of  a  medium  then,  are  the 
capabilities  of  tha^  medium       to  sho^i 
objects  in  motion,  objects  in  color,  objects 
in  three  dimensions;  to  provide  printed 
*  words,  simultaneous  visual  and  auditory 

stimuli;  to  allow  for  overt  learner 
responses  or  random  access  to  information. 
(Levie  and  Dickie,  1973,  p.  860) 
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THEORY  INTO  PRACTICE 

IuDrlan?illon  value  on  the  ba^ls  If.  -  1)  Analysis-  of  processes 
re??ec"d  b?  field-dependent/independent  cognitive  style,  and 

2)  extensive  task  analysis. 

The  Effect  of  Cognit5^r*>  Rt-yle  on  Concept  Attainment 

In  a  typical  visual  .concept-attainment  task,  J^arners  are  required  to 
dL^ingSish  examples  from  non-examples  of  v^°""P^^^i^;^;    ^°  ^ 

n-.^^^  1-^4  e  ^^lcV  enrressfullv.  a  learner  needs  tne  aptituae 

^cqi?^^%=^rSi«:%ejiai^^^^^^^^^ 

-^La??f  L^^u^M  ^  Vlassif.  e.a.ples^as 

lea^=raplL^^?o%^ 

visual  into  its  component  details.  ^^"""nH^senerallze  Information  as 
in  the  strategies  thej^use  to  stru^^^^^^^ 

L-Mitefemf e   y^^^^^^  ' 

Witkin,  Moore,  Goodenough  and  Cox,  19/7) .  a  =  . 

The  current  vCev  of  f  ie"; J-P-^f  «;i;,^|r;ra"oi;iex"Ld^^^^^ 
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individuals  who  are  perceptually  ^ie^^;^^^^^^^ 

'experience  their  world  in  J^J^^Sj^^g^^'^^i^SlnoSgh  Sc  Oltman,  1977; 
with  perceptual/cognitive  tasks  ^WitKin^  fearnar  tends  to 

Wilkin  Ec  Goodenough    1977) .    The  J';®!^         ^he  strategies  used  in 

Hence    £l«"-^SrE*~Liaf,rde?alL  Se  oo^  Sfd^liU^  (Goodenough. 
materials  in  which  relevant  details  are  not  m  tendency  to  . 

1976-  Witkin,  Moore,  Goodenough  8c  Cox,  1^  7i„^  fho 

il^^lav  less  differentiated  functioning  Is  also  evident  In  the 

features  are  associated  with  positive  examples  of  the  concept 

(Witkin,  Moore,  Goodenough  be  Cox,  1^//;.  ^ 

This  strategy  may  be  contrasted  with  the  active,  participant  role^of 

aitrerenciaueu  internal  mediational  propesses  (Witkin, 

restructuring  skills  as  incernax  hvoothesis-testing  strategies 

Moore    Goodenough  5t  Cox,  1977;.    Tneir  nypotueBio  i-^o    ^  ^Q^f,. 

WoJi',?  !?r^sppf'i?rjth  H  kirig  ""^^ 

-?US:nreTa?'ei?u!I??f ^^^^^^^^^ 

?Bruner,  Goodnow  &  Austin,  1956;  Bourne,  1966). 

In  his  "discussion  of  l^ypothesis-testing  st« 

pointed  out  that  the  superiority  onll  to°remember 

t-rt  ^^R  reduced' demands,  on  memory.    The  whollst  nas  onxy  uu^cm 
^Se  att^butls  ol  the  first  example.    Subsequent  checks  against 


avoid  using  them  twice. 
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In  sununary,  it  is  important  to  note  that  ^°th  approaches  can  Je^  to 
successful'concept  attainment  (Nebelkopf  and  Dreyer    1973T7  However, 
fleld-deoendent  learners  do  have  more  difficulty  than  _ 
filld-independent  learners  with  discrimination  tasks.    That  is  they 
have  less  ability  to  break  down  a  visual  into  its  component  4etail^. 
^S'coife^t  it^nLg  tasks  in  which  relevant  Retails  are  not  made  . 
obvious    the  field-dependent  learner  may  be  at  a  disadvantage 
(wltSn;  Moore"  GoodenougH         Gox,  1977).  Furthermore^ 
field-d4pendent*and  field- independent  learners  <3o  differ  in  the 
methods  thev  use  to  generalize  information  into  concepts.    Thus,  wnen 
material  to' be  learnid  is  not  clearly  structured  ' 

field-dependent  learners  ^ay  e^P«-'i«?Sf,}«^'^?^^f/i^|^J^iJ^y^ay  be  - 
(Witkin,  Moore,  Goodenough  and  Cox,  1977).    Their  difficulty  may 
particularly  apparent  when  instructional  time  is  limited  by  a 
fixed-pace  presentation  (cf.  Bruner  et.  al.,  1956,  Bourne,  i^oijj  ^ 

The  relationship  between  field- dependence-  ' 
irdependence  and  concept  attainment  is  of 
'  '       particular  concern  to  educators  because  of 

tlieir  interest  itl  having  students  learn 
concepts,  rather  than  facts  alone.  /t,ls 
therefor^  natural  to  ask  how  field- dependent 
students  may  be  aided  ...     .   (Aitkin,  Moore, 
Goodenough  and  Cox,  1977,  p.  26).  ^ 

The  Effect  of  Medja  Attributes        '  ^ 

ir^««^l>  n  q82'>  has  developed  an  Aptitude  Sensitive  Instruction 

sfms"" ehf  ?Urner!VIIap?  tl  the^ptltude  of  the  student 
(rtench,  1982) . 

ThU  approach  places  an  ^"phasis  upon  learners'  f°«?g/f^i2l5Seit  of 
V  «M  "4™-"-^^^^^^^^^^  it  is 

initial  hypothesis  about  the  relations  between  m  affect  or 

can  be  stated  as  follows:    a).  Different  ^"ributes  or  mea 
stimulate  different  internal  opera tions^f  the  learner  ^^{^^^^^^^ 
learners  often  r^po^d  to  the  |ame  informatio^^      ?n.var3:ous  ways  and 
,  ways:     ^PP^^^ently  they  perceive  tne  s^^^  Learning,  will -be  most 

fflfcli«rtC  i^aS^S^Tocess"?n-cisily  ad^usled' to  th, 
processes  the  learner  has  to  carry  out. 

(■  „  -  IBS 
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.    t.        c   A  «v„^«  and  French  (1^82)  advocate  the  usfe  of"  media 

iS1brm\'AS(  5?""aS  F.>«h  a|82)  view  this  .edia    i.^  «  a 
Figure  1) .      "  ^-  ^  ' 

The  tJresent  study  sought  to  utilize  media^attributes  according  to  an 
aptitSdrsensitiJe  approach  which  was  aimed  t(f  increase  the 
effectiveness  of  instructional  materials  .for  all  subj^ffts. 
IpSifically!^ the  study  aimed  to  use  a  compensatory  ^upplantation  ^ 
approach  to'^facilitate  concepj;  attainment  f  ?:?^P|^?^Son  " 

learners,  by  "shprt  circuiting'  processing  demand^  Ccf.  Salomon, 

strategies  for  field- independent  learners.    ^  \    ^  ^ 

The  present  ^tudy  incorporated  the  use  of  several .medi#  attributes 
iStcE  varie/b^^^^^^^ 

?I?Iable;  wSrwfrrsefelLrSrco^ding  to  the  hypothesized  function 
thev  may  perform' for  lear;iers  differing  iti  aptitude.     Th^  three 

a)  color  versus  non-color  type  of  cueing; 

b)  simple- versus,  complex  degree  of  informative  detail; 

'      c)    .  inductive  versus  deductive  type  of  verbal  presentation.  -  ^ 

The  first  treatment  variable  o^  interest  was  that  of  the  "se  o€. 
color'-cueiSg  of  relevant  vis'ial  details.  v.In  color-cued  treatments 

Li  ™nf  features  (attributes)  of  each  concept  class  were  .colored 
Jn%Id!  -    SothtSSir (1920)  and. ^Tribasso.  (1963)  have  used  red  to 
emphasize  relevant  attributes  as  an  effective  aid  to 


of  color: 


a)  to  direct  attention  to  relevant  details^by  making  puesmdre 
,  salient  >nd  by  delineating  figure-ground  relatiopships . 

b)  to  isolate  details  while  maintaining  context  relationships 
as  an  aid  in  making  discriminations;  ^     ,  « 

c)  to  provide  organizational  aids  by  showing  interrelatedness. 
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It  was. hypothesized  that  these  functions  may  facilitate  concept 
att^inmeit  by  increasing  the  salience  of  relevant  conce^  , 
attributes.    However,  color  aPP^ars Ntp  be  a  "fragile  cue  .. .ao^  to 
be  suoerceded  by  more  potent  cuea"  (Otta-£c  Askov,  1968, ^p.  lb j;. 
Both  O^oH  Lk^v  and  ?hute  (1979)>  have  suggested  that  Instructional, 
materials  should  not  have  color,  afi^  the"  only  ^''^  r^^^i^^^^^^ 
facilitate  processing,  especiaUy  in  co^lex  tasksvthat  are  high  in  - 
•s?Wuf  siSla?"y.^*T^il  shoSS  not  be  interpreted  to^suggest  fhaf , 
color  is  an  ineffective  cue.  .When  used  to  perform  J^^^*^^!"^.  , ,^ - 

function  (cf.  Chute,  1^79),  '^ol^'^  rSnJ^fl^w 

«Vion         rplevant  conc^t  attriT>ute  i's  embedded  ("rabas SO,  i^^oj;.^ 

til  Chute1l9?9)  InS'Smberski  &  Roberts  (1979)^  have  suggested  that 

the  value  c/f  color  may  lie  in  its  possible  interrelated  role. 

'  '^^  ■  ' 

Trabasso  (1963)  revealed  that  the  effect  of  color  emphasizers  may  be - 
^educe^by  couiter-emphasizers,  that  is ,  irreleyant  if  oj^f  V^^^^ 
Sas  not  held  constant^ppeared^to  compete,  for  the  s^^^ 
bv  directifiR  the  learner  away  f pom  relevant  details.  Mariy 
%ltiInt-cSl  theorists  (e-g-.  Canelos.  1979;  Dwy«^^ 
that  in -some  learning,  tasks,  complexity  should  be  edited  or  . 
simplified  in  order  to  avoid  processing  interference  caused  by  too 
man?  relevant  cues.    To  test  these  views,  the  present  study  included 
bo?^  lii^iruL-drawing  and  complex  line-drawing  treatm^  • 
second  independent,  treatment  variable.     This  variable  was  cermea  . 
de??ee  ^f  lSlormative  detail,  in  order  to  reinforc'e  that  degree,  of^  ^, 
abttrlttion/relTism.  was  not  .used  to  differentiate  simple  from  complex 
line- drawings.  '  •    .  ^  '  k:''::  : 

Iii  complex  treatments,  the  line-drawings  were  high 
deta??rtSat  is,  they  showed- a  high  degree  of  interior Jfigur^e)  and 
ground  detail  that;  was  not^elated  to  the  f^^^ept.    Simple      _  - 
/It-owI litre  were  lower  in  degree  of  informative  detail,  tnat  xs, 
ihey  SeS^malSy  ie^lvant  inferior  (figure)  detail  ^^d  "  little_^^ 
irrelevanrdetail  as  possible.    Several  functional  considerations  led 

4o  thHSclSsion  of  simple  degree  of  if°5J?Ji^«„J^^?ii,^"  "  . 

.  study.    These  included  the  hypothesized  ability  of  simple  • 

line-drawings:.  ,  • 

a)  to  isolate  details  while  maintaining  context  Relationships 
(qf.  Heidt,  1977);        ^  -*       ,  . 

b)  to  reduce  the  count er-emphasizer  effect  of  .irrelevant  \ 
stimuli  (cf.  Trabasso^  1963);  .  • 

*  c)   ■  to'  deorease  abstraction  time  and  learner  ef f orf  (cf .  _ 

Canelos,  1979;; Fleming  &  Sheikhian,  1972;^  and  Joseph,  1979). 

d)      to  facilitate  objectives  requiring  the  comprehension  and  ^ 
explanation  of  concepts  (cf.  Arnold  &  Dwyer,  1975).  - 
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"3l?o??™"  mrii?Sblfilc  inductive,  versus  deductive 

mode  of  verbal  presentation.  o  . 

Both  inductive  and  deductive  treatments  were  presented  via  an 

Sf  l^ch  concept  type.    The  deductive  presentation  wa|  We 
4™m«.HlArelv  before 'the  visual  presentation  of  examples  and         ^  , 

Seb^fs^Sc^ 

?Se  p?dvis?on  of  a  concept  definition  in  additio>  to  a  set  of  . 
teaching^xamples  has  be^n  found  to  be  siRnific&ntly  mor^  iqyov 
^«^^^^^f^ive  than  a  "set  of  teaching  examples  aloncf  (Feldman,  .197<>- 

learners  to  learn  effectively,  they  should,  be  presented  with 
i!c£ground  information  as  a  ba^-is  for  ^^^^^^f^^T^^^^:,^ 

;ds^!t«i^^i/^^^^  • 

'^^^'Tilini^irfe'^r^^Fji^e?!  ^^^^^^^.  ^ 

Tel?    B^fef  on  the  pf;ceSnrresearch  findings several  functional^ 
considerations  led  to^the  inclusion  pf  deduct iye^ mode  of  presentation 
JS  the  present  study.     These  included  the  hypothesized- ability  of 
deduct;lve  presentations:  - 

a)       to  direct  attention  to  relevant  details, through^the  use  of 
/erbal  cues  and  by  increasing  redundancy  of  critical, 
information;     *  '  ;       '  '• 

b>      to  provide  organizational  aids  through  advance  verbal 
description  of  relevant  details. 
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METHODOLOGY 


The  study  utilized  a  treatments-by-blocks  design,  (cf.  Keppel,  1982)., 
The  aptitude  block  was  composed. of  two  levels:    extreme  . 
field- independent  individuals  and  extreme  field-dependent 
individuals.    Aptitude  blocks  were  designated  on  the  basis  of 
performance  on  the  Group  Embedded  Figures  T^st  (Witkin,  Oltman, 
Raskin  SdKarp,  1971).^  Fie id- independent  subjects  were  determined  . 
to  represent  the  upper  27-1/2%  of  highest -^scoring  subjects. 
Field-dependent  subjects  were  determined  to  represent  t^e  lower 
27-1/2%  of  lowest  scoring  subjects  (cf.  Feldt,  1961}. 

The  subject  sample  of"492  males  aged  16-21  years,  was  drawn  from  a 
Colleee  of  Technical  and  Further  Education  in  Melbourne,  Australia. 
All  subjects  were  trade  apprentices  predominantly  from  the  automotive 
department.    As  subjects  were  trade  apprenti<:es,  the  classification 
of  five^-^types  of  diesel  fuel  injectors  was  determined  to  be  an 
appropriate  concept  attainment  task.    Five  types  of  injectors  were  / 
selected  to  represent  five  different  concept  classes;    Wost  of  the 
injectors  had  global  similarities,  yet,  each  concept  ^J^ss  had^ 
^  specific  differences  which  allowed  for  the  classification  of  each 
example  into  one  of  the  five  concept  groups. 

The  instructional  materials  consisted  of  a  series  of ' line-drjwin&s. 
which  were  copied  onto  filmstrips  with  an  accompanying  audiotape. 
Sublects  were  pretested  for  e^tflsting  knpwledge,  and  then  randomly  . 
I^signed  ?o  an^Individual  sound filmltrip  machine . whiqh^was-  loaded 
with  -ODe  of  the  treatment  combinati'ons .     Each  treatment- was  , 
externally-paced.    The  three  treatment  variables  combined  to  €orm 
eilS  treatLnts,  each  of  which- contained  either  color  or  non^color 
culing,  plus  either  simple  or,  complex  H^e-drawings  accompanied  by^an 
inductive  or  deductive  verbal  pre  sent  at  ion..    By  administering,  these. 
e?ghf  Slatment  combinations  to  .eacA  pt  the  aptitude^blocks  a  total 
•of  Rtxteen  treatment  croups  were  formed.     Thus,  a  2  x  2  3C  Z  x  Z  • 
.fa^oS"?  exl?SI-grlups'deslgn  v*^"?^''  "  Implement  thlB  stOdy. 
Six^denendent  variables  were  measured  for  all  subjects.     For  tnis 
discussion,  the  results  of  two  immediate  posttest  measures  will  be  , 
outlined  and  compared.  ^  ,  ■  ' 

i)      An  Identification  test,     (This  test  is  referred  to  as.  the 
•line-drawing  test.)     Following  the  completion  of  all  - 
instructional  sequences,  the  subjects  ^.ere  presented  with  a 
series  of  21  line-drawings.     Sublects  were  also  given  an 
answer  sheet  numbered  from  1  to  21,  with  the  names  of  .each 
-   of  the  five  injector  types  rep^eated  for  each  item.    The  ^; 
test  required  that  each  subject  view  each  line-drawing,  and 
this  identify  the  injector  type  by  circling  the  appropriable 
.      name  for  the  cortesp.onding  item  oh  the  numbered ^aifewer 
'  sheet.^  The  choice  of  21  line-drawings  was  based  on  a  _ 

concept  analysis  conducted, by  the  researcher,  prior  to  the 

experiment.  /     .  '     *  ^ 
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The  ability  to  identify  different  examples  as  ^^%]^^^^^^ 
saL  concept  claii-ippiarp  to  relate  most  specifically  to  the 
elafsificator?  level  of  Klausmeier,  Ghatala  Sc  Prayer's  model  of 
SiSclptUal  lllrning  (1974),    At  the  classificatory  level,  the 
leS?ner  not  only  cin  discriminate  and  recognize  concept 
a^tSbutes'   but  also  can  generalize  to  other  examples  on  the 
baSs  of  specif ic,:common^attributes.    It  is  important  to  note 

Xt  learners  who'performed  well  on  the  li-?-^"^^?^  ^^"^Se'' 
"We  reached  the  formal  level  of  Klausmeier's  model.    At  the 
formal  level  the  learner  can  identify  «^^°^Pl«%S"^  "S^^^^Jlf 
of  the  concept,  and  most  importantly  can  name  the  concept  ana 
accurately  l^eAtify  it  in  terms  of  all  its  relevant  attributes. 

b)      An  identification  -  transfer  test  (called  the  realia 
test). — Following  completion  ot  all  instructional 
iimJences,  the  subjects  Weife  presented  with  a  series  of 
••r2al  fuel  injectors"  for  identification.    Th^  test  _ 
required  that  each  subject  view  and  handle  each  injector, 
and  then  Identify  it  by  circling  the  appropriate^name  on  a 
numbered  answer  sheet.    This  test  is  similar  to  the 
preceding  identification,  line-drawing  test  in  that  it  alsc 
delated  fd  Klausmeier,  Ghatala  and  Prayer's  classificatory 
and  perhaps  formal  levels  of  concept  learning  (1974). 
Howe?er,  in  the  realia  (identification-transfer)  test,  the 
learner  was  required  to  transfer  learning  from  the^ 
two-dimensional,  line-drawn  representations  of  |"^1  , 
inlectors  to  actual  three-dimensional  realia.    The  realia 
pos^tes^was  included  as  a  practicai;'real  vorld'  measure 
of  student  achievement.  -Selection  of  the  seven. items  for 
the  identification-transfer  (realia)  test  was  based  on 
detailed  conciept  analysis. 


DATA  ANALYSIS 


A  four-vay  analysts  of  variance  was  used  ^o^-f  ^^^'th^^e^^fatSent 
and  interactions  among  the  four  factors,  that      »  ^ne  ^"  ^^^^ 
variables  and  the  subject  aptitude  variable.    Where  a  8i|nitlca 

Keppel  (1973,  1982)  and  Kirk' (1968) . 

It  should  be  noted  that  there  was  some  subject  ^^^^^alit^  after  . 
subject  allocation  to  treatments  resulting  i^^^^used  by  ^qu^pment 
treitment  of  groups.     These  s"bJ«^5,,J:°f  ^^M^?"uty  was  not  related 
breakdown  and  administrative  Procedures.    "j^^^^^J.^'^Jth  unequal 
to  the  experimental  treatments.    Analyses  °f  J^^^^fJ^^f ^J^lation  of 
sample  sizes  may  warrant  consideration  of         P°"^5!\y^2  1968). 
the  homogeneity  of  variance  assumption  (^l^^l^l^^lll^^^ 
Hence,  in  the  present  ^^udy,  this  assumption  ^Hg^^^^l^^^^f  f ^J^eated 
Hartley  Test  using. procedures  given  ^^^^(g^^^^         1).  This 

this  study.  o 
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RESULTS 

The  Pretest 


Analyses  of  scores  for  the  pretest  of  prior  knowledge  revealed  that^^ 
iMIeflnd^Sf  f^rrie!l'fere"ndent1?rupsfl  ^247)  -  1.08.-H>  -l- 


The  Postteste 


This  paper  will  focus  upon  a  comparison  of  three-way  interactions 
revealed  by  the  posttest  measures. 

The  Line-Drawings  Posttest  . 
rreSrariin^-.^'ihf  Lduititi  tleat.ejtj 

The  analysis  of  line-drawing  scores  also  revealed  two  statistically 
IViri  In^£teraction. 

2  staO  V  <  .05?    Table  2^provides  a  summary  of  the  analysis  of 


£ 

variance . 


The  Dresence  of  significant  interactions  in  the  analysis  of  variance 
Anders  the  main  effects  uninterpretable  without  further  analyses  of 
JSS  nature  of  the  interactions.    These  tests  were  conducted  and  led 

iXri^^?LSe°Uable^ 

were  signiflcan^^ln  non-color-cued  --.ents.^F Jl,229)^  ,„.er4ction. 
effects  may  be  found  in  Table  3. 
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between  deductively  presented,  =3l«^«|X?"ely  pretexted ,  ^ 

Simple,  color-cued  treatmeigts;  F  (l,2i9)  -  6.95,  £  <  -Ul. 
Figure  2  (left  panel)  and  Table  4.  - 

A  second  set^of  simple,  simple  »al„  e«e« 

deeree  of  informative  detail,     inese  Hii«xyoc  ^„„r.iiav 

inluctlve,  non-color  " . Q  "s!?! V<  !o^^    There  was 

inductive  ^^IfS^^U/sli;^^^  deductlvf .  non-color 

?°e:^^:nSn"SS  L'^p'?  x^y^^^^       "°bf ratSIS'Sf ^l^ul  fwss  not 

IfcL«l??-cl^?^^^^^^^^^^ 

infill  e  4S-P-i  -^^^^^^^^^^^  .l,„re 

treatments  and  complex,  inauccive, 
2  (left  panel)  and  Table  4. 

All  treatment  group  means  and  "«''^«^^„^|Y^?S^?2bUr5''and  6.  The 
lKa:lSrs  llllllll  ^lXlT.^"lV&n^^'''^s  r„  -  .72. 

The  Realia  Posttest 

significant  three-way  ^-^teractlon.  ^ic  is  impu 

main  effects  of  the  factors  involved  in  the  interaction  ^^^^ 

significant  in  the  overall  *?*^y^J^*^2ted  without  qualification. 

I£l"i^^ls°g^°vl^ay/S^a^^^^^ 

field-dependent  subjects,  F  (1,231)  -  7.Ji,  £  ."x 
The  analysis  of  realia  P-ttest  scores^also  r^^^ 

three-way  interaction.         J'^^^V^^'^cueinR  X  degree  of  informative 
interaction;  that  is,  type       ^°i°^„^"|^?f  231)  -  6.44,  p  < .025. 
detail  X  mode  of  verbal  P'^^^^^JS^^aSallsis  of  scored  oA  the  realia 
Table  7  provides  a  summary  of  the  analysis  or  scores 


posttest  items 
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of  simple  interaction  effects ^revealed  that  the  interaction  effect 
SfsnS?  significant  in  color- cued  treatments  (B  x  C  at  n) .but  was 
slanTTTcant  in  non-color- cued  treatments  (B  x  C  at-ao),  F  (1,231)  - 
S  f 9    ;  <    01      In  other  words,  the  tests  of  simple  Interaction 
eifectl  ^ndJkteS  tSat  ^h3  interaction  of  simple/complex  treatments 
with  inductive/deductive  treatments  was  not  significant  for 
color-cSed  materials,  but  was  significant  in  Jo^Z^^Jf ^ 
treatments.    A  summary  of  the  results  of ^the  tests  of  simple 
interaction  effects  may  be  found  in  Table  V. 

The  significance  of  the  B  x  C  interaction  for  non-color-cued 
mflLrills  fao^  siiBBested  further  analysis.     Subseq^ent  analyses 
coSfIs?ed  oPLitfirthe  variation  amSng  the  cells  of  a  given  row  or 
colSmn  of  the  non-cllor  matrix;  that  is,  testing  ^-P^f » ^^^^Pj%f 
effects  of  factors  wittiin  the  non- color  matrix.    The  first  sei.  or 
tests  of  simple,  simple  main  effects  focused  on  factor  B 
(8?mpl^/complex--deg?ee  of  informative  detail).    These  tests  sought 
to  ditlrmine  the  influence  of  factor  B  at  levels  azd  (non-color 
inductive),  and  a2C2  (non-color-deductive).    The  results  of  these 
iests  of  simple,  liSpie  main  effects  may 

■reference  to  the  right  panel  of  Figure  3.    The  test  ot  B  at  a2ci 

/I  9^^^  «  8  04    S  ^  .01  (see  Figure  3  and  Table  V;.    iiowever,  une 
illllll  of  iSe'tls^  if  simple,  limple  main  effects  indicated  that 
there  was  no  significant  difference  between  simple,  non-color, 
deduct?"  ??eitLnJs  and  complex,  non-color,  deductive  treatments- 

A  second  set  of  tests  of  simple,  ^imple^main  effects  focused  on  ^ 

factor  C  (inductive/deductive  --  mode  of  ^J^^l  P"^^f  J^^^J^^  *  ^^"^ 

tests  sought  to  determine  the  influence  of  factor  C  at  levels 

a2bi  (non-color,  simple),  and  ?2b2. (non- color,  complex). 

Results  of  these  tests  ot  simple,  simple  main  ettects  may  oe  ^ 

l"ei|?e?ed  vlth  reference  to  the  right  panel  °f  "f"?  f    The  test 

r  A^  AoSi  -rt^wal&d  a  significant  difference,  F  Cl,ZJi;  - 
?9  5o    t>  <^001  (tee  Table  9>.    Inspection  of  the  appropriate  means 

3^^^^^  ^^^^  ^vf^ ' 

Si-eatments  in  ?he  test  of  C  at  a2b2  (see  Table  9,  and  Figure  3). 
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Tests  of  simple,  simple  main  effects  were  extended  to  determine  the 
influeSL  of  both  factor  B  and  factor  C  among  the  cells  of  a  given 
Jow  or  colSmn  of  the  color-cued  matrix.    The  results  of  these  tests 
o?  sample,  simple  main  effects  may  be  interpreted  with  reference  to 
the  left  panel  of  Figure  3.     The  tests  of  B  at  aid  and  B  at 
aic2  were  not  .significant  (see  Table  9)  .    ^he  tests  of  C^at 
aibi  and  G  at  aib2  were  also  not  significant  <see  Tabit  9, 
and  Figure  3) . 

All  treatment  group"  means  and  standard  deviations  Jff 
posttest  have  been-  presented  on  Tables  10  and  11.     The  realla 
posttest  reliability,  coefficient  was  r^^  -  .42. 
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Discussion 


The  saccess  -of  atten.pte  to  Improve  the  general  effectiveness  of  . 
I^st"""na?.  materials  for  |H  ^IJ^J^^f  a^  treatment 

significant  fi""?86  reporteH-Ior  both  ij«J^|^J''2^„?^„«tlons  were 
main  effects  for  both  posttests.    some  trearaenu        ^  this  nay 

more  effective  than  otters  Jor  .iJ^'H  mlt«  which 

suggest  that  it  is  possible  to  utl^ 

rcI«iu!'p?ocesl?;?s«at:g[es:\ut  alio  provlde^^ 

m«ei\n^2n^.Slr^^^^^^^^^ 
kSas"M."n?Ll5y-pg^^^^^^ 

^IlLJSv^Se^S  in^Sn^SSeSrc^J^iri^nJ  1^^^^^^^^ 

and  to  generalize. 

Ztt7nlf'T."llf^  t^  lilor-cSrfreatments  differed  to  the 

interrelated  role. 

Analyses  of  simple,  simple  main  ««|"^(H||ii55||5§£f||),S|naf 
and  3.) 

Performance  In  non-color-cued  treatments  was^n2|facllita^ 

inl^ojllSrmeraSVtLiq^^^^^^^^  l^llf 
deductive  presentations  in  color-cued  treatments,  evident  in^c 

aU  o?S^r  nin-co?or-cued  treatm^g  on  the  realia  posttest. 
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•The  aooarent  superiority  of  simple,' inductive" presentations  in. 
non-SlS-cued  treatments  may  be  related  to  the  u"ij"%P"""?i"|ners 
deSands  of  the  realia  posttes^.    This  P°J""S  required  ^hat^ea^^^^ 
demonstrate  concept  attainment  by  correctly  "^"tifying  realia  wtiicn 
beloneed  to  the  same  concept  class.    The  realia  (identification; 
pos??ls?  differed  frpm  the^ine-drawings  (identification)  posttest  .n 
that  the  realia  measure  required  that  learners  tr5S|fi£their 
knowledee  to  identify  actiial  examples  of  the  concept^     The  .processes 
required  to  transfer  learning  in  order  to  classify  actual  concept 
examples  appear  to  have  been  aided  by  non-colpr-cued ,  s imple , 
inductive  presentations.     In  other  words,  n?":''-°l?F»,J:"^"2n1^?ve 
presentations  may  have  freed  learners  to  utilize  their  cognitive 
Restructuring  skills  and'  hypothesis  testing  strategies  when  ^ 
simplified  visuals  were  used.    The  inductive  treatments  may  have 
Iacilita?ed  transfer  by  actively  invoTvInT^a^h  learner  in  propessing 
cdncept  information  when  used  in  conjunction  ^itb^t^e  other  two 
variables.     The  simple  -line-drawings  may  have  contributed  the 
In^e^ac^ie  effe^l^T     (a)  directing  attention  through  removing 
irrelevant  details  and  thus  reducing  their  counteremphasizer  effect, 
(b)  directing  attention  to  relevant  cues  and  thus  delineating 
figure-ground  relationships;   (c)  isolating  relevant  concept 
attributes;  and  (d)  decreasing  abstraction  time  and  effort.     Thf. .  ^, 
fSSctional  attributes  of  simplified  visuals  may  have  been  of  critical 
f^portance  fo^  LS-aptitude  Larners      ^hese  field- dependent  learners 
mav  have  had  difficulty  in  successfully  completing  the  task  wnen 
non-color,  inductive  presentations.,  (low  in  ffj-^^f  ,Se^aLir[on"ol 
This  difficulty  may  have  been  accentuated  without  the  addition  of 
simplified  visSal/to  isolate  relevant  details  and  to  direct 
attention. 

Previous  research  findings  provide  partial  ^"PPS^t^f or  the  findings 
in  their  own  learning. 

Although  the  three-way  interaction  of  all  treatment  variables 
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IMPLICATIONS 


Pro.  the  findings  of  this  s tug  the  foUow^^^^^^^ 

have  been  proposed  as  guides  f°J„f"ture  researcn         f  attributes 

relating  to  aptitude  ^^^f    The  f inSingsof  this  study  are 

in  optimizing.transfer  of  training.    The  ^f  ^^l^  stimulus  may 
based  upon  the  view  that  attributes  or  ^  me  ^^^^^^ 

1.  m  general,  field-dependent  P-f  ^-nrara^el^ab"/''""'' 

rrrtri;^;'"f»'rd^nriiifaUo^?ii^^^^^^^^ 

field-dependent  learners.  «  ^ 

2.  In  general f ie"- independent  performance  on^an  ex^ 

fffrVtrffil^^^^^^^^^^^ 

S?mpie-!  deductive,  color  treatments  may  have  functioned  to 
actuat4  appropriate  processing  strengths,  thus  reducing 
abstraction  time  and  effort.  ■  ■  ^ 

3.      Materials  designed  to  teach  ^  concept  m^^^  when 
n^edia  attributes  are  selected  with  sensi^^^^  the^ognitive 

^    processing  demands  of  the  tasK  as  .  gtudv  the 

Styles  of  the  learners.    Jor  example    ^J^^hls  etudy^t^^^^^^^^ 

•      irexte™luy-pac?nrea^n?«ioS!^  flmfle.^^^ 
?;eSS«fi^rriaci?ltated  for  both  s^^^^^^ 

'  i|"Sfc«X'?o"1ieli-indeJlnde^    K^v^luala    it  may  Lave 

of  processing  f^^^^^";  |  ^  field- dependent  learners. 

Sffiic^l^ori^^^^^^^^^ 

rnn"«^:Slzf  i'n^oS^fti'c'oL^pt  classes.  Improved 
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field-dependent  performance  in  simple,  deductive,  color 
treatments  may  be  attributed  to  their  supplantation  value  in 
compensating  for  these  processing  differences.    Hence,  simple, 
deductive,  color  treatments  may  have  facilitated  tbe  performance 
of  both  field- independent  and  field-dependent  groups  in  , 
different  ways.  ,  ' 

The  attributes  of  color-cueing  may  have  a  possible  interrelated 
role  in  concept-attainment  tasks  in  which  performance  is 
measured  through  the  use  of  both  line-drawings  dhd  realia.  A 
comparison  of  the  significant  three-way  interaction 
(color/non-color  x  inductive/deductive  x  simple/complex)  for  the 
line-drawings  posttest  in  Figura  2  with  the  three-way 
interaction  of  the  same  variables  for  the  realia  posttest  in 
Figure  3,  wiy.  illustrate  the  potential  of  the  interrelated  role 
of  color. 

In  concept-attainment  tasks,  media  attributes  can  facilita^ 
information  transfer  from  two  dimensional  instructional  ^ 
materials  to  realia.    For  example,  simple,  inductive,  non-color 
treatments  facilitated  perfopaance  for  all  subjects  in 
treatments  that  were  not  color-cued  in  the  realia  posttest. 
This  effect  was  not  apparent  in  the  line-drawings  posttest 
scores.    The  difference  in  findings  may  be  related  to  the  unique 
processing  demands  of- the  realia  posttest  which  required 
learners  to  transfer  knowledge  and  to  identify  actual  examples 
of  the  concept  (realia)  that  were  taught  the  line-drawings. 
Simple,  inductive,  non-color  presentations  may  have  freed 
learners  to  actually  utilize  cognitive  restructuring  skills  and 
hypothesis  testing  strategies.    These  tre^itments  may  have 
facilitated  transfer  by  actively  involving  each  learner  In 
processing  concept  information. 

Ease  of  transfer  to  real  objects  may  be'  facilitated  by  media 
attributes  which  function  to: 

(a)     free  the  learner  to  utilize  restructuring  skills  and 
hypothesis  testing  strategies 


and/or 

(b)  permit  active  processing  involvement  by  the  learner. 

(c)  increase  the  salience  of  relevant  cues  by  isolating 
relevant  details  and  directing  attention  to  relevant 
details.    Attention  may  be  directed  by  delineating 
figure-ground  relationships  and  reducing  the 
qounteremphaslzer  effect  of  irrelevant  details. 

(d)  decrease  abstraction  time  and  effort 
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^      Concluding  Comments 

>  responsive  to  aearners^rocessing  needs    instructional  des^^^  . 

•       needs  to  be  sensitive  to  the  complex  interrelationships  between 
vArtflbles  which  contribute  to  instructional  effectiveness.  By 
mt^gingtheo^riS^S  Practice,  instructional  designers  may  paster  the 
art  of  developing  instructional  materials  that  are  truely  altitude 
sensitive.  , 
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O  ure  2:  Graph  of  treatment  means  of  the  significant  three-way  interaction 
ERIC  (color /non-co^or  X. simple/complex  X  inductive/deductive 

—  —  treatments)— line-drawing  posttest       x^-^  • 
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Table  1 


Results  of  Hartley's  Test  of  Homogeneity  of 
Variance  for  all  Posttest  Scores 
(Kirk,  1968,  p.  62) 


Posttest 

Largest 
Variance 

Smallest 
Variance 

df 

F 

—  max. 

Line 
Drawings 

23.98 

7.27 

16,13 

3.30* 

Realia 

3.74 

1.60 

16,16 

.2.34* 

*  £  >  .05 


209 
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Table  Z 


j!inalysis  of  Variance  for  Scoiftes  on  Line  Drawing 
Posttest  Items 


Source  of  Variance 


SS 


df 


MS 


A    Color /Non-Color  Treatments 

B    Simple/Ccmplex  Treatments 

C  Inductive/Deductive 
Treatments 

D    Field-Dependent- Independent 
Aptitude 


AxB 
AxC 
AxD 
BxC 
BxO 
CXD 

AxBxC 
AxBxD 
AxCxD 
BxCxD 

AxBxCxD 

Explained' 
Residual 


1.106 
141.401 

161.716 

816.918 

0.017 
6.591 
0.884 
27.057 
85.416 
2.330 

71.710 
3.945 
42.299 
10.584 

10.117 


1.106 
141.401 

161.716 

816.918 

0.017 
6.591 
0.884 
27.057 
85.416 
2.330 

71.710 
3.945 
42.299 
10.584 


0.08 
10.45** 

11.95*** 

60.36**** 

0.00 

0.49 

p. 07 

2.00 

6.31* 

0.17 

5.30* 
0.29 
^  3.13 
0.78 


10.117  0.75 


1407.626  15  93.842  6.93 
3099.174    229  13.534 


TOTAL 


4506.800  244 


18.470 


*  .£  <.025 

**  £  <..  01 

•**  £  <.001 

****  £  <.0001 
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Table  3 


ERIC 


SuxtDBary  of  Variance  for  Scores  on  the  Line- 
Drawings  Posttest  Items,  Including  Tests  for 
Simple  Interaction  Effects . 
{Adapted  from  Keppel ,  1973,  pp.2e6-290, 
pp.325-327,  pp.360-362j     1982,  pp. 304-309, 
pp. 341-344?  and  Kirk,  1968,  pp.222-224) 


Source  of  Variance 


SS 


df 


MS 


A  Color/Non-Color 
Treatments 

B    Simple/Complex  Treatments 

C  Inductive/Deductive 
Treatments 


1.106 
141.401 

161.716 


1 
1 


1.106 

141.401 

■  \^ 

161.716 


0.08 
10.45*** 

il.95*** 


BxC 


27.057       1  27.057 


1.99 


BxC  at  °a. 


BxC  at  a. 


9.347 
66.023 


1 
1 


9.347 
66.023 


0.69 
4.87* 


AxBxC 


71.710 


71.710 


5.30** 


Residual 
TOTAL 


3099.174  229  13.534 
4506.^00      244  18.470 


* 
** 
*** 


E<  .05 
£<  .025 

£<  ,001 


1.  Bj  -  color-cued 

"  noii-color  cued 
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TAble  4 


Sunnnary  of  the  Analysis  of  Variance  on  Line- 
Drawing  Test  Items,  Including  Tests  for  Simple, 
Simple  Main  Effects 

^KdApt^i  from  Xeppel,  1973,  pp. 290-292, 
pp. 326-32?,  pp. 360-362;    1982,  pp. 309-311 i 
and  Kirk,  1968,  pp.  ^222-223) 


Source  of  Variance ' 


SS 


df 


MS 


A   Color /Non-Color 

Treatments  1.106 

B    Single/Complex  Treatments  141.401 


C  Inductive/Deductive 
Treatments 

AxB 
AxC 
BxC 


B  at  c^ 
B  at  a^  c^ 


B  at  a^ 
B  at  aj 

C  at  a^ 
cat  a^b^ 

C  at  a^  b^' 
C  at  a^  b^ 


AxBx<; 

Residual 
TOTAL 


161.716 

0.017 
6.591 
27.057 

/ 91710 
55.354 

132.046 


94.090 
28.896 

0.388 
146.758 

71.710 

3099. i74 
4506.800 


1.106 
141.401 

161.716 

0.017 
6.591 
27.051 

9.710 
55.354 

132.046 


94.090 
28.896 

0.388 
146.758 

71.710 

229  13.534 
U  18.470 


E< 


.05 
.025 


£  <.01 
••••    £  <-001 


0.08 
10. 45**** 

11. 95**** 

0.00  . 
0.49  t 
2.09 

0.72 
4.09* 

9.76*** 

6.95*** 
2.14 

0.03 
10. 84**** 

5.30** 


a  the 
1.  ' 


Man  scores  for  thesa  calls  were  aquuil 

•  color-cu2d 
■  non-color  cued 
simple  line-dcawing 


complex  line-drawing 
Inductive  presentation 
deductive  presentation 


BESTCOPYAWBLB 
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Table  5 


Treatment  Group  Means  and  Standard  Deviations  for  Ileld-Dependent  and  Pield-lndependent 
'       Aptitude  (Line-Drawing  Poattast) 


TREATMENTS  APTITUDE-  ROM 

Pield-Dependent  Pield-lndependent 

'    X        (SB)        n.  X     :     (SB)  IL  W 


1.  Siinple,lnductive,  Non-color  10.00  (2.89)  19  13.93  (3.43)  15  11.74  *  (3.67)  34 

2.  SiiBple,lnductive,    -  . -color  7.27  (3.47)  15  13.85'  (2.91)  13  10.32  (4.60)  28 

3.  Complex^lnductive,  Non-color  -    7.88  (3.04)  17  9.75  (3.45)  16  8.79  (3.33)  33 

4.  Cb«nplex,lnductive,.        Color  8.53  (3.78)  15  10.44  (4.35)  16  9.52  (4.13)  ,  31 

5.  Simple^Deductive,  N«n-Colpr  8.54  (2.70)  13  14.47  (3:69)  17  xl.9Q  (4.41)  30 


6.  Simple, Deductive, 


Color  11.06      (4.07)      16  14.67       (3.75)      15        12.81      (4.27)  31 


7.  Complex,Deductive,  Non-Color- 


9.86      (4.90)      14  13.80       (3.63)      15        11.90      (4.66)  29 


J.  Cc«plex,Deductiv,        Color  9.80      (4.34)      15  12.07       (3.83)      14        10,90      (4.19)  29 


CX)LUHN 


9.15      (3.78)    124  12.84       (3.99)    121       .10.97      (4<30)  245 
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Table  6 


Treataftent  Group  Means  and  Standard  Deviations  for  Aptitude  x 
Degree  of  Informative  DetaU  x  Type  of  Color-Cuelng  x  Mode 
of  Presentation  (Line-Drawing  Posttest) 


TREATMENTS 

Pield-Dependent 
X        (SD)  n. 

APTITUDE  ^ 

Field-Independent. 
X     ■    (SDJ  n. 

I 

ROW 
(SE) 

a 

A.  Degree  of  Infomiative  Detail  i 
(low)  Simple 
(high)  Complex 

9.32 
8.97 

(3.56) 
(4.02) 

63 
61 

14.25 
11.45 

(3.42) 
(4.06) 

60 
61 

'11.72 
10.21 

(^.27) 
(4.21) 

/l23 
/ 122 

B.  Type  of  Color  Cueing: 
Color-Cued 
Non-Color- 

9.20 
9.10 

(4.13) 
(3.45) 

61 
63 

12i69 
0.2.96 

(4.02) 
(3.78) 

58 

.  63 

10.90 
11.04 

(4.42)/ 
(4.20) 

ii9 

126 

C.  Mode  of  Presentitlont  ,,  5^,      „         10.10      (4.04I  126 

Sd^rtiv:  W-W  13.80      (3.73)      61         11,89      (4.3f  119 


COLOMM 


9.15      (3.78)    124  12.84      (3.99)    121  10.97  (4.3( 


)  245 


229 


Table  7 


Analysis  of  Variance  6f. Scores  on  Realia  Test  Items 


ERIC 


Source  of  Variance 

QI 

F 

A    Color/Non-Color  Treatments 

0.180 

1 

0.180 

0.07 

B    Simple/Cojnplex  Treatments 

8.036 

*  0*. 

1 

8.036 

3.2A 

C    Induct  Ive  /Deduct  Ive 
Treatments 

8.322 

:l  .' 

8.322 

.  3,36 

D.  Field— Dependent— inaep en aent 
Aptitude  - 

18.210' 

1 , 

18.210 

7.35** 

AxB 

0.017 

1  • 

0.017 

0.01 

3.759 

1 

3.759 

1.52 

0.,011 

1 

0.011 

0.01 

7v383 

1.  ° 

7.383 

2.98. 

BxD  , 

0.008 

1 

0.008 

0.00 

1.2A2 

1  . 

1.2A2 

0.50 

AxBxC 

16.A7b 

*  ■,  y 

1 

16.A70 

6.AA* 

AxBxD 

0.046 

1 

0.0A6 

"0.-02 

AxCxD 

'  5.608 

1 

5.608 

2.26 

BxCxD                               .      r  . 

/  0.928 

1 

0.928 

0.38 

A.  298 

._-A,29'b 

 1.73__ 

•AxBxCxD 

73.A35- 

-15r 

-   A .896 

1.98 

Residual 


T0TA7- 


*  .025 
**  £<  .01 


572.622  231  2.A79 
6A6.057    2A6  2.626 
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Table  8 


Summary  of  the  Analysis  of  Variance  for  Scores 

on  Realia  Posttest  Items,  Including  Tests  for 

Simple  Interaction  Effects. 

(Adapted  from  Keppel,  1973,  pp. 286-290, 

pp. 325-326,  pp. 360-362;     1982,  pp. 304-309, 

pp.341-344)    and  Kirk,  1968,  pp.222-224) 


Source  of  Variance 


SS 


df 


MS 


F 


A  Color/Non-Color 
Treatments 

B    simjple/COTjplex  Treatments 

C  liiductive/Deductive 

Treatments  > 


BxC 


0.081  1 

8.036  1 

8.322  1 

7.383  1 


0.081 
8.036 

8.322 

7.383 


0.07 
3.24 

* 

3.36 
2.98 


BxC  at  a. 


BxC  at  a. 


1.046  1 


1.046 


21.378         1  21.378 


0.42 
8.62** 


AxBxC 


16.470 


16.470 


6,64* 


Residual 
TOTAL 


572.622 


231  2.479 


646.057       246  2.626 


ERIC 


ft  £<  .025 
**    £<  .01 
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Table  9 


Summary  of  the  Analysis  of  Variance  for  Scores 
on  Realia  Posttest  Items,  Including  Tests  for 
Simple,  Simple  Main  Effects.  - 
(Adapted  from  Keppel,  1973,  pp. 290-292, 
pp. 326-327,  pp. 360-362;     1982,  pp.309-311| 
and  Kirk,  1968,  pp. 222-223) 


Source  of  Variance 


A  Color/Nbn-Color 

O.IBQ 

1          p. 180 

0.07 

8.036 

1  8.036 

3,24 

C  Iiiductive/Deductive 
Tre&tiaents 

8.322 

1  8.322 

J  •  JO 

AxB 

p 

0.017 

1   ^        0  017 

0.01  / 
1.52  ^ 

JixC 

3.759 

i  3.759 

BxC 

7.383 

1  7.383 

2.98 

B  at  ^ 

0.393 

1 

B  at  a. 

1  2 

.  4.307 

1  .  4.307 

1.74 

B  at  a^  c. 
2  1 

19.927 

1  19.927 

8.04** 

B  at  aj  C2 

8.491 

1        .  8.491 

3.43 

C  at  aj^  ^ 

0.055 

1  0.055 

0.02 

C^at  a,  , 

1.475. 

1  1.475 

0.59 

C  at  aj  bj^            I  "  ■ 

30.484 

1  30.484 

12.30*** 

C  at 

1.037 

1  1.037 

0.42 

AxBxC 

16.470 

„1  16.470 

6.64* 

Residual 

572.622 

231  2.479 

TOTAL 

646.057 

246  2.626 

*  £  <.025 
**  £  <.01 
***  £  <.O01 


Table  10 


Treatnent  Group  Means  and  Standard  Deviations  for  Field-Dependent  and  Field-Independent 

Aptitude  (Realia  Posttest^ 


TREATMENTS  ^ 

APTITUDE ' 

BOW 

Field-Dependent 

Field-Independent 

A 

(SB). 

n 

X 

(SD) 

n  ' 

1. 

Simple , Inductive, '  Non-Color 

3.61  > 

(1.75) 

18 

3.66 

(1.40) 

15 

3.64 

(1.58) 

33 

2. 

Simple, Inductive,  Color 

2.40 

(1.40) 

15 

3.57  " 

(1.60) 

14 

2.97 

(1.59) 

29 

3. 

Complex, Inductive, Non-Color 

2.35 

(1.93). 

17 

2.65 

(1.50) 

17 

2.50 

(1.71) 

34 

4.' 

Complex , Inductive , Col or 

2.67 

(1.35) 

15 

2.94 

(ir^4) 

16 

2.81 

(1.38) 

31 

5. 

Simple, Deductive,  Non-Color 

.  1.54 

(1-.27) 

13 

2.76. 

(1.86T 

17 

2.23 

(1.72)  . 

30 

6. 

Single, Deductive,  Color 

3.00 

(1.26) 

16 

3.07 

(1.07) 

15 

3.03 

(1.45) 

31 

7. 

Complex , Deductive , Non-Color 

'2.29 

(1.54) 

14 

^    3.20  ° 

(1.61) 

'  15 

« 

.  5.76 

(1.62) 

29 

8.  Conplexf, Deductive, Color. 

2.13 

(1.36) 

15 

2.87 

(1.88) 

15 

2.50 

(1.66) 

30 

COLDMN 

2.54 

(1.59) 

123 

•  3.07 

(1.62) 

124 

2.81 

(1.62) 

247 
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Table  11 

Treatment  Group  Means  and  Standard  Deviations  for  Aptitude  x 
Degree  of  Informative  Detail  x  Type  of  Color  Cueing. x  Mode 
of  Presentation  (Realia  Posttest) 


TREATMENTS 


APTITUDE 

Pield-Dependent  iPield-Independent 
X        (SDJ        n  X  (SS)  


A.  Degree  of  Informative  Details 
(low)  Simple 
(high)  Complex 


2.73 
2.36 


(1.61) 
(1.54) 


62 
61 


3.24 
2.90 


(1.65) 
(1.58) 


61 
63 


2.98 
2.64 


ROW 


(1.64)  123 
(1.58)  124 


B.  Type  of  Color  Cueing; 
Color-Cued 
Non-Color 


2^56 
2.53 


(1.35) 
(l.SO) 


61 
62 


3.10 
3.05 


(1.63) 
(1.62) 


60 
64 


2. 83 
2.79 


(1.51), 
(1.72) 


121 
126 


C.  Mode  of  Presentations 
•  Inductive 
Deductive 


2.78 
2.28 


(1.61) 
(1.37! 


65 
58 


2.54      (1.59)  123 


3.18 
2.97 


(1.48) 
(1.75) 


62 
62 


3,07        (1.62)  124 


2.98 
2.63 


(1.61) 
(1.62) 


127 
120 


2.81      (1.62)  247 
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ABSTRACT 

A  total  of  121  third  and  fourth  graders  were  randomly  assigned  to 
instructional  treatments  which  each  featured  a  short  children's  story. 
The  treatments  wc»"e  (ral-only,  picture-only,,  and  a 'combination  of  oral 
and  pictures.  Students  saw  and/or  heard  the  presentation  and  were 
tested  immediately  and  after  a  two-week  retnetion  interval  for  recall  of 
abstract  and  concrete  presentation  content.  As  expected,  the  combined 
presentation  yielded  the  greates  xecall  of  both  abstract  ^nd  concrete 
content.        Oral-only    a^d      picture-only      presentations    were  equally 

effective    for    abstract  content,  but  the  picture  presentation  was  more 

i  ^ 
effective    for    concrete  content.    In  effect,  picture  presentation  were 

relatively  more  effective  overall  than  oral-only  presentations. 
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THE  RELATIVE. EFFECTIVENESS  OF  PICTURES  VERSUS  WORDS 
IN  CONVEYING  ABSTRACT  AND  CONCRETE  PROSE 


-Wbl-l:Jrry=to -derive 

classr9b^  learning  settings.  A  large  percentage  of  classroom 
instrdction  is  presented  to  prospective  learners  through  oral  or  written- 
prose./  Prose  learning  typically  involves  different  information 
processing  skills  from  simple  paired  associate  or  serial  learning  tasks* 
For\  example,  contextual  and  inferential  learning  are  more  often 
associated  with  prose  learning  than  other  types  of  isolated  learning 
tasks.  Consequently,  much  of  the  non-prose  research'  regarding 
presentation  stimuli  effects  may  not  be  readi^ly  generalizable  to  prose 
learning  tasks.  For  these  reasons,  the  continued  investigation  of  prose 
i:.ng  ef.tects  warrants  attention* 

The  mythical  best  audiovisual  presentation  medium  has  been  pursued 
1  sively  during  the  past  several  years*  T^he  supplementary  effect  of 
pictures  when  applied  to  oral  presentations  has  also,  been  investigated* 
Leviri  and  Lesgold  (1978)  listed  several  conditions  under  which  pictures 
facilitate    the    learning    of  oral  prose:     learners  should*   be  children 

rathfer    than    adults,    pictures    must  overlap  with    story    content',  and 

) 

learning    should    be  demonstrated  by  factual  recall*      Researchers  have 

/  ^ 
generally    found    that  pictures  are  effective  supplements  to  prose  when 

such    ;:>ictures    are  well  designed  and  congruent  with  prose    content  and 

sequence     (Carrier  &  Clark,  1978;  Haring  &  Fry,  1979;  Lesgold,  Curtis,  & 


learn 


exten 
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DeGood,     1975;  Lesgold,  Levin,  Shimron,  &  Gutttnann,  1975;  Levin,  Bender, 

&    Lesgold,     1976;    Levin  &  Berry,  1980;  Peng  &  Levin,     1979;  Pressleyi 

1977;  Rusted  &  Coltheart,  1979). 

Although' the  use  of  well-designed  and    congruent    pictures  has 

resulted    in    positive    effects  on  learning  when  paired    with  different 

JL^Lpes — of — firose^— the—re  laxi-ive— in f-nrma 1 1  on-^rr-ying^  Jvalue-of  verbal — and— 

picture    presentations    is  unclear*    Many  researchers  who  have  compared 

the    effectiveness    of    verbal  and  pictorial  presentations  of    the  same 

information    have  concluded  that  verbal  presentations  are  generally  more 

effective    than  pictorial  presentation.    Howiever,  these  findings  are  by 

no    means    conclusive    (Fleming,  1979).    Conflicting  results    have  been 

reported    recently    1[e.g.,     Rohwer  &  Harris,  1975  vs.    Hannafin,  1981). 

Consequently  definitive  conclusions  rejgarding  the  relative  effectiveness 

of^different  presentation  stimulu  are  not  readily  derived  from  existing 

research.  .       '    ■  ^ 

Some  studies  designed  to  investigate  the  relative  effectiveness  of 

♦ 

pictures  and  verbal  presentations  may  have  been  confounded  by  loading 
effects,  i.e.,  effects  due  to  differentially  loading  either  verbal  or 
visual  presentations  with  criterion  information  (Hannafin,  1983).  While 
loading  bias  often  reflects  accuratel^y  a  natural  weighting  of 
information  .found  in  many  materials,  it  is  unlikely  that  the*  potential 
of  a  given  medium  to  transmit  information  Is  accurately  assessed  using 
such  materials.  Recently,  researchers  have  found  that  both  verbal  and 
pictorial  presentations  enhance  student  learning  when  each  presentation 
is  systematically  and  equally  loaded  with  criterion  information  (Carey  & 
Hannafin,  1981). 
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The  type  of  information  to  be  remembered  in  prose  learning  also 
warrants  further  study  (Salomon  &  Clark,  1977),  Paivio  (1971)  suggested 
that  the  most  powerful  factor  that  determines  how  well  information  will 
be  remembered  is  its  location  on  a  continuum  of  concretenessr 
abstractness:  The  more  concrete,  the  more  easily  remeinbered;  the  more 
abstract^r^-the^Jiar^er-^to— 


suggested  that  the  concr^teness  or  abstractness  of  information  interacts 
with  the  stimulus  attributes  of  the  presentation  medium.  Verbal 
presentations  may  be  more  effective  than  visual  presentations  for 
teaching  abstract  information  and  visual  presentations  may  be  more 
effective  than  verbal  presentations  for  teaching  concrete  information* 
Research  findings,  howeyer,  have  not  consistently  supported  this 
hypothesis*  Other  ^resarchers  have  found  that  although  visual 
presentations  are  more.  effective  than  verbal  presentations  in 
communicating  concrete  information,  no  significant  differences  exist 
between  visual  and  verbal  presentations  in  communicating  abstract 
information  (Hannafin,  1981,  1983).  The  nature  or^exfstence  of  Paivio 
and~Toth*s  (1970)  postulated  interaction  between  presentation  medium  and 
relative  concreteness  of  information  to  be  learned,  therefore,  remains 
unclear*  .       j        '  .  . 

The  purposes  of  the  present  student  were  to  investigate  the 
relative  effectiveness  of  different  vetbal  versus  pictorial  Audiovisual 
presentations  on  student  recall  of  concrete  and  abstract  prose* 
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METHODS 


Subjects  f 

A  total  of  60  third-grade  and  60  fourth-grade  students  served  as 

subjects.      Students  were  selected  from  either  of  two  sehools  located  in 

  ^  

a  pre dominant iy  middle-class  suburban  school  district. 

*  *  ■  'i .  •  , 

*  .  c  . 

/  .  ~*  ■ 

'  '  ,  ■  ■*  ■  • 

Materials  / 

Three  presentations,  each  depicting  an  adapted  children's  text.  The 
Wump  ,-Wprld     (Peet,     1970),  were. used..    Each  of  the  story    versions  was 
systematically    loaded    with    both      concrete      and    abstract  criterion 
information.      The  Wump  World  is  a  high  interest,  animated  \story;  with  a 
Spache    graded  '^readability    estimate  of  4.8.    The    story    was  ^lightly 
adapted    to    include  both  concrete  and  abstract  information^    The  three 
presentations    included:    ORAL,  an  audiotape  verbal  presentation  of    the ^ 
story;    PICS,     a  35-mm  slide  presentation  of  the  text  pictures    used  to 
depict,    the    story;,  and  ORAL  +  PIf:S,  a  combination  of  the  audiotape  and 
35-nim  lides* 

Each  of  the  presentation  versions  was  18  minutes  in  duration  and 

■■'  "  *  * 

paced  identically  to  control  student  time  on  task. 

»  .  ■ 

Criterion  Measure 

The  criterion  measure  was  a  2A-item  short-answer  test,  consisting 

c 

of    12    items  measuring  recall  of  abstract  information  presented  in  the 

story    and    12    items    measuring  recall  of  concrete    information.   ^  The 

.  concreteness-abstractness    of  the  test  information,  where  possible,  was 
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based  on"  the  ratings  provided  by  Palvlo  et  al.  (1968).  :  Reliability 
coefficients  for  the  24-ltem  test  used  in  thfe  present  study  were '.ye  for 
the    12-item  abstract  scale,  .85  for  thT  r2-ltem  concrete  scale,  and  ,87 

for  the  full-length  criterion  test*  4 

»  -  *  ■  •  ■ 

c  ^ 

All  test  directions  and  questions  were  presented  and"  paced  via 
audiotape. ^  . 


Procedures  ' -  . 

Students  were  randomly  assigned  to  presentation    treatment  group' 
assignments.        Students    thpn    he^rd  and/or  viewed  The    Wump    World  in 
accordance    with    presentation    group       assignment^.         Following  1:he 
presentation,     there  vjas  a  brief  interpolated  activity  ^duiang  which  the 


students  stood  and  stretched  at  their  assigned  seats  while  test  answer 
sheets  were  distributed  to  them.  ^ 

The  criterion  test  was  administered  i^th  as  a  measure  of  immediate 
recall    and    also^one  week  after  ^the  initial  story    presentation    as  a 
measure'  of   ^delayed    recall    and    retention!        The    delayed    test  was. 
administered  to  all  students  in  their  home  classrooms. 

/    '        ^   '  .    '  ■     ■•     •  .    ■  •  ..  /  'j'  ■  ', 

Design  and  Data  Analysis  ' 

The  research  design  was-^a  completely  xirossed  3x2x2  factorial 

•«     •  », 

design  with  repeated  measures  on  both  the  test  scale  and  the  test 
interval.  The  three  levels  of  presentation  (ORAL^*,  PICS,  and  ORAL  + 
PICS)  were  crossed  wj.th  two  levels  of  ability  (HI  and  LO),  and.  both 
factors  were  crossed  with  grade, level  (THIRD  and  FOURTH).  The  -learner 
ability  classifications  were  based  upon  a  median  split  of  student  scores 
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on  a  group-^drainisteted^ standardized  intelligence  test.  The  test  scale 
yielded-  immediate  and  delayed  scores  ^  for  concrete  and  abstracjt 
information.  ■  ,  ' 

In  addition  to  the  immediate  and  delayed  scores  for  cbncrete  and 
abstract  information,  a  relative  effectiveness  j>core  was  derived  t«by 
subtracting  the  concrete  sc<yre  from  the  corresponding  abstract  score  for 
the  immediate  test,  the  delayed  test,  and  the  overall  repeated  measure. 

Due  to  chance  cell  imbalance,  resulting  primarily  from  attrition, 
students  were  randomly  eliminated  from  the  analysis  in  order  to  balance 
the  -.cell  sizes. 

Separate  repeated  measure  MANOVAs  were  conducted  for  recall  and  for 
the  relative  effectiveness  scores.  In  addition,  planned  orthogonal 
contrasts  were  conducted  for  each  anticipated  effect  source. 
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RESULTS 

Recall  Effects 

The  inean  recall  scores  for  both  abstract  and  concrete  scales  ere 
contained  in  Table  1.  As  expected,  recall  of  concrete  information  was 
significantly  greater  than  abstract  recall,  F(l,108)«  15.83,  p.<.0001. 
The    results     further    indicated  significant        presentation  group 

differences,  F(2,108)=13.81,p<.0001,  and  a  presentation  by  scale 
interaction    F(2,108)=6.21,p<.005.        The  ORAL  +  PICS    presentation  was 

r. 

consistently  the  most  effective^ for  both  abstract  and  concrete  recall* 
The  mean  scores  obtained  by  the  ORAL  and  PICS  presentation  groups  for 
abstract  recall  "were  comparable  but  the  PICS  presentation  was 
significantly  more  effective  than  the  ORAL  presentation- for  recall  of 
concrete  content. 

Expected  differences  were  also  found  for  learner  ability^ 
F(l,108)=13.57,p<.001.  HI  ability  learners  consistently  out  performed 
LO  learners  across  scale,  test  interval,  presentation,  and  grade  level. 

Grade  level  effects  were  also  found  for  test  recall, 
F(l,180)»4.73,p<.05,     and    the    grade      level-by-test    scale  interation 

F(l,108)=9.02,p<.005.        Fourth    graders  consistently,     but  marginally,' 

-  X 

out-performed    third  graders.    The  differences  were  most  pronounced  for 

concrete    recall,  where  fourth  graders  recalled  proportionately  greater 

'ft 

information  than  third  grader*^. 


Insert'  Table  1  About  Here 

'  / 

/ 

•    .  ,  ,/  
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Relative  Effectiveness  Scores 

The  relative  effectiveness  scores,  measures  of  the  difference  in 
;  student  recal'l  of  abstract  and  concrete  information,  are  shown  for  both 
the  imiuediate  and  the  delayed  test  in  Table  2.  The  scores  indicate  the 
direction  and  magnitude  in  which  differences  in  learning  occurred: 
positive  .res  indicate  greater  learning,  of  abstract  than  concrete 
content;  negative  scores  indicate  greater  learning  of  concrete  than 
abstract  consent • 

Differences  in  relative  effectiveness  were  found  for  presntation 
group,  F(2,108)=»6.21,p<.005,  and  for  grade  level,  F(l,108)«9.02,p<.005. 
The  ORAL  +  PICS  presentation  yielded  greater  relative  effectiveness 
'differences  than  either  the  PICS  or  the  ORAL    presentation  (p<.01). 

Similar  differences  wq^e  found  between  the  PICS  and  the  ORAL 
presentations  (p<.01)  with  relatively  greater  learning  of  concrete 
information  than  abstract  information  in  the. PICS  and  ORAL  +  PICS 
presentations,  and  slightly  greater  learning  of  abstract  information 
under  the  OR/.L  presentation.  •  These  differences  were  most  pronounced  for 
the     fourth    graders,    with  relatively  greater    concrete    than  abstract 

■ .  x     ■  ■  - 

learning.  \. 

.  ;  . 

No  other  significant  dif f erenceV  were  found. 


Insert  Table  2  About  Here 
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DISCUSSION 

The  present  study  was  .conducted  to  determine  the  relative 
effectiveness  of  different  prose  presentation  fbrms  on  the  learning  of 
concrete  and  abstract  prose.  The  results  indicated  that  student 
learning  of  both  abstract  and  concrete  prose  was  differentially  affected 
by  the  form  of  prose  presentation.  '  . 

The  combined  oral-plus-pictures  presentation  yielded  the  highest 
recall    of  both  concrete  and  abstract  content.    Although  this  result  was 

c 

expected,  the  magnitude  of  the  performance  difference  between  the 
-oral-plus-picture  presentation  and  both  the  oral  and  pictures 
presentation  is  noteworthy.  As  noted  by  several  researchers  (Lesgold, 
Levin,  Shimron,  &  Guttman,  1975;  Levin  et  al.,  1976;  Pressley,  1977), 
well-designed  and  congruent  pictures  are  effective  supplements  to  oral 
or  written  prose.  However,  the  relative  supplementary  contribution  of 
pictures  to  oral  'prose  or  oral  prose  to  pictures  has  been  unclear*  In 
the  present  study,  pictures  were  found  to  be  highly  effective 
supplements  to  the  oral  prose  presentation. •  The  oral-plus-pictures 
presentations  resulted  in  signficantly  greater  recall  of  both  abstract 
content  and  concrete  content  than  the  oral-only  presentation.  The 
difference  was  greatest  for  concrete  content,  where  the  mean  score  for 
the  oral-plus-pictures  presentation  was  more  than  double  the  mean  score 
for  the  oral  presentation.  This  result  suggests  that  the  supplementary 
value  of  pictures,  although  evident~for  BoFh  colTcrteite "  and"^^ 
content;,  may  be  most  pronounced  for  concrete  content. 

  Performance  was  also  improved  through  the  addition  of     the  oral 
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component    to    pictures    depicting  prose.      However,     the  supplementary 
effect    of    the    oral    presentation  to    pictures,    demonstrated    by  ^  the 
performance    differences    between  the  picture-only  presentation  and  the 
oral-plus-picture  presentations,  was  less  pronounced  and  more  consistent 
than    the  oral-only  versus  oral-plus-presentation.    The  contrast  between 
the    effects    of    picture  versus  oral  story    supplements    suggests  that 
well-designed    pictures^may~be^~raore"eFfectiTe  suppleme^        to  oral  prose 
than    oral    story  supplements  are  to  pictured  prose.    In    addition,  the 
relative    effectiveness    of  picture  supplements  may  be  affectJd    by  the 
type    of    information,     concrete    or  abstract,  to  be    learned  ,  from  the 

presentation.  \        _  . 

The  finding  that  the  systematically  loaded  picture  presentation  was 
equal    in    effectiveness  to  the  oral  presentation  in  conveying  abstract 
content    is    of  particular  interest.    These  findings  provide  additional 
support     for    the    conclusions  made  by  previous    researchers  (Hannafin, 
1983).        The  results  could  be  related  to  the  clarity  of  each  medium  in 
communicating    abstract    or  concrete  content  to  learners,  since  learner 
acquisition    undoubtedly  is  affected  by  the  clarity  of  the  presentation 
medium    in  conveying  the  information.    Concrete  information,  as  defined 
in    the    present  study,  can  be  presented  unambiguously  in  both  pictures 
and    words.        Abstract,   information,  on  the  other    hand,    may    be  more 
difficult    to  present  unambigu^ly  in  .pictures  than  in  words  because  it 
tends    to  be  subject  to  greater  interpretation  when  portrayed  in  picture 
form.        Consequently,     student  learning  from  pictures  is  likely    to  be 


greatest  when  the  picturability  of  the  content  is  unambiguous.  Thus, 
picture    presentations  would  be  more  effective  ior  concrete  content  than 
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for  abstract  content.  .  .0 

The  manner  in  which  information  is    represented    internally  by 
learners    could    provide    a  further  explanation  of    the    differendes  in 
perf ormanc    by    present at ion»    Presentations  that  include  combined  ^  oral 
and    picture  forms  typically  require  less  interpretation  by  learners  and 
result    in    greater  learning*     In  order  to  produce  a  verbal  response  to 
demonstrate    the    recall  of  information  presented  initially  in  pictured 
form    only,  however,  at  least  two  steps  are  required*    The  learner  first 
must    encode  the  picture  and  then  must  label  the  picture  verbally*  Oral 
presentations    do    not  require  a  transformation  of  the  information  from 
one    form    to  the  other  since  both  presentation  and  response    modes  are 
verbal    in    nature  (Kosslyn,  1978,  1980)*    Consequently,  an  ordering  of 
learning  outcomes  might  be  predicted  based  upon  the  modality  required  to 
encode    presented    information    and  the  modality  required  to    produce  a 
response    to    demonstrate    acquisition  of  information*     In    the  present 
study,     the    presentations    that    include  both  oral    and    picture  forms 
resulted    in    the    greatest  learning;  presentations  that    included  only 
picture    forms    yielded    the    next         most        effective    learning,  and 
presentations    that     included    only    the  oral  form    produced    the  least 
effective    learning*        This  pattern  was  more    pronounced    for  concrete 
content  than  abstract  content,  since  the  difference  between  the  oral  and 
picture    presentations    was  significant  only  f or  concre  t e  content  *  The 
pattern    of  performance  by  presentation  group  was  identical  for  abstract 
content,     although    the  difference  was  not  statistically  reliable*  As 
suggested    earlier,     this    could    be  related  to  the    greater    claity  of 
pictures  in  conveying  concrete  content  than  abstract  content* 
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The  results  of  the  analysis  of  relative  learning  of  abstract  and 
concrete    content    within    each  presentation  indicate  that  the    type  of. 
information    to    be  ' learned    interacts  with    the    presentation  medium. 
Educators    frequently    evaluate    the        effectiveness    of  instructional 
products    based  upon  the  degree  to  which  intended  learning  results  from 
the    use    of    the    products.     lu  the  present    study,     intended  learning 
included    both    abstract  and  concrete  prose^  content.    Students    in  oral 
presentations    recalled    relatively  more  abstract  content  than  concrete 
content,    while  students  in  picture  and  oral-plus-picture  presentations 
recalled  more  concrete  content  than  abstract  content.    The  effectiveness 
of    presentation    media,  therefore,  appears  to  be  affected  partially  by 
the    type    of    information,     concrete  or  abstract,     to    be    conveyed  to 
learners. 

In  the  present  study,  a  number  of  issues  pertaining  to  the  relative 
effectiveness  of  different  presentation  stimuli  have  been  raised  and 
tested.  Certainly,  it  is  unlikely  that  even  the  most  enthusiastic  of 
"picture  researchers"  will  advocate  the  wholesale  scrapping  of 
oral-aural  instruction  in  favor  of  visual-only  instruction.  It  is 
important  to  note,  however,  that  much  of  the  cognitive  psychology  and 
human  learning  literature  has  also  emphasized  the  functions  and 
effectiveness  of  visual  images  in  encoding,  retaining,  and  decoding 
information  for  skills  rangir.g  from  simple  list  learning  to  recall  of 
prose    facts    and    features.  Perhaps    the    instructional  technology 

profession,  and  the  picture  research  component  in-particular,  will 
expand  the  notions  of  the  external  stimuli  to  include  the  internal 
processing  component  of  learning  from  pictures.  { 


I 
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Table  1 

Mean  Recall  Scores  for  the  Immediate  Test'  and  the  Retention  Test 


Presentation 


Grade 


ORAL 


PICS 


ORAL+PICS 


Totals 


Level 

Abil. 

Abs 

COH 

Abs 

Con 

Abs 

Con 

Abs 

Con 

Immediate  Test 

Third  . 

HI 

3.1 

3.1 

3.9 

3.6 

5.5 

6.6 

4.2 

4.4 

LO 

2.9 

2.4 

2.6 

2.8 

4.9. 

5.5 

3.5 

3.6 

Fourth 

HI 

3.9 

4.6 

5.3 

6.6 

5.6 

7.9 

4.9 

6.4 

Totals 

LO 
HI 

2.5 
3.5 

2.7 
3.8 

3.7 
A. 6 

5.6 
5.1 

3.7 
5.5 

5.6 
7.2 

3.3\ 
4.5 

4.6 
5.4 

Retention  Test 

Third 

HI 

4.3 

■3.7 

3.7 

4.3 

5.7 

6.8 

4.6 

6.6'\ 

LO 

2.6 

,2.0 

3.0 

7.0 

5.5 

5.7 

3.7 

4.9 

Fourth 

HI 

4,8 

4.7 

5.1 

3.1 

5.9 

7. '9  " 

5.3 

5.2 

1,0 

3.1 

2.7 

3.9 

5.2 

3.8 

5.2 

3.6 

4.4 

Totals 

HI 

4.5 

4.2 

A.  4 

3.7 

5.8 

•7.4 

4.9. 

5.1 

\ 

LO 

2.8 

2.4 

3.5 

6.1 

4.7 

■  5.5 

3.7 

4.7 

\ 
\ 

Notes,     Abs  =  Abstract  Scale;  Con  =  Concrete  Scale.     Total  points 
possible  for  each  scale  =  12«   _..   
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Table  2  | 

Relative  Effectiveness  Scores  for  Immediate  Test  and  Retention  Test 


Fourth 


LO 

HI 
LO 


Totals 


HI 
LO 


Presentation 


Grade 

Level 

Je  ;Abil 

1 

ORAL 

PICS 

Totals 

.  i 

Immediate 

Test 

Third 

Ihi 

0.00 

.33 

-1.10 

-.27 

iLO 

•  .50 

-.20 

-.60 

-.10 

Fourth 

HI 

-.70 

-1.36 

-2.30 

-1 . 45 

LO 

1 

-.20 

-2.36 

-1.78 

-1.45 

Totals 

HI 

-.35 

-.52 

-1.70 

-.86 

LO 

.15 

-1.28 

-1.19 

,  -.78 

"Retention 

Test 

Third 

HI, 

.60 

-.67 

-1.10. 

"-.39 

.60 

.10/ 

/ 

.40 


-.10 
-1.91 
-1.27 


-.20 
-2.00 
>-1.44 


.50 


Not&s.     Relative  Eff 
Concrete. _Sca|l 
valences  indli 


ectiveness  Scores  computed  by  subtracting  the 


-1.29 
-.69 


-1.55 
-.82 


.10 
-1.27 
-.77 


-.83 
-.38 


.e..score  from.  the.  Abstract  Scale  -Score.--  Negative 
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Abstract 


Flashes  of  insight  or  mental  leaps  are  commonly  associated  with 
problem  solving.  >This  phenomenon  Vequi res  careful  naturalitic  metho- 
dology with  a  comprehensive  approach  that  investigates  the  dynamics  of 
a  situation  to  illuminate  such'  factors  as  prior  knowledge,  motivation, 
internal  and  external  imagery,  perseverance,  executive  processes  and 
problem-solving  approaches.    It  is  the  belief  of  this  author  that_|x 
post  facto  research  or  experimental  research  does  not  allow  tor  tne 
•Wl^i^^T^atKl-^i-c-faies£-of-^e^-nt^^^  inherent  in  mental  imaqery  

and  the  problem  solving  processes.  ^  ^    ,      ,    ^    v.«Ki<.a,c  t 

When  I  attempted  to  investigate  how  students  solved  problems,  I 
found  that  they  had  verbalized,  visualized,  added  and  subtracted  infor- 
mation, and  recalled  past  experiences.    Students  made  internal  represen- 
tations of  the  puzzles  presented  to  them  and  then  used  these  internal^ 
representations  for  sorting  through  information,  acting  out  situations, 
rehearsing  solutions  and  keeping  track  of  decisions  made  in  the  prob  em 
solving  process.    Students  also,  made  external  representations.of  their  _ 
internal  representations.    The  external  representations  were  symbols 
of  the  internal  processing  and  provided  a  record  of  decisions  made, 
of  knowledge  discovered  and  of  solutions  presented.    These  kinds  of. 
externa    representations  have  the  potential  to  become- records  of  thought 
to  sSare  with  others  in  the  class;  therefore,  I  felt  it  important  to 
stress  to  the  students  the  need  for  externally  representing  their 
thoug  ts  on  the -instruments  provided.    They  could  then  use  . these  external 
representations  to  share  with  others  the  thipking  process  involved  in 

^^^^^Vtrr^explanatlo^oV  visual  rehearsal,  students  had\he  opportunity 
to  experiencfthe  pricess.    Visual  rehearsal,  an  aspect  of  mental  imagery, 
is  ?he^Jnt rolled  and  conscious  act  of  visualizing  situations,  people 
and  behavio?  for  planning  for  the  future.    A  student  might^visual ize 
the  important  procedures  in  a  difficult  task  before  actually  performing 
t  at  Ssk'^Results.  showed  that  visual  rehearsal  helps^the  ;ndividuar 
to  gain  insight  an^develop  problem  solving  schemas.    With  the  results 
in  mind,  I  developed  several  instruments  containing  visual  and  verbal 
problems  to  give  training  =in  the  use  of- visual  rehearsal  and  mental 
imagery. 
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Problem  Solving 

Technology  and  change  in  our  society  create  the  need  to  develop 

better  methods  to  prepare  students  for  the  future./  Gregory  wrote, 
"These  situations  demand  different  skill s:    diffe^rent  ways  of  ordering. 


handling  and  sesing  objects"  (p.  166).    No -longer  are  remembering 
information  or  ^/en  knowing  where  to  find  it   enough  to  keep  up 
with  our  changing  worlcl.    An  innovative  approach  to  help  students 
understand  and  prepare  for  the  future  is  the  use  of  mental  imagery 
in  problem  soTvfng.    Problem  solving  prepares  students  for  changing 
situati-ons.     If  we /can  get  students  to  visualize  new  situations  and 
help  them  becone  better  problem  solvers,  then  we  are  preparing  them 
to  take  responsiibiljny  to  meet  the  challenges  of  change.  Conventional 
experimental  research  in  visualization  and  mental  imagery  presents 
us  with  conflicting  findings  (Guba  &  Linpoln.  19B2,  p.  234).  Paivio 
(1971)  describes  imagery  as  a  photographic  reproduction  of  what  the 
subject  sees.   This\picture  taking  of  the  mind's  eye,  he  said,  is 
a  one-to-one  ctrrespondence  to  the  external  event.    Penfield  (1975) 
supports  this  theory  \ith  his  experiments  involving  electrical  probing 
of  the  brains  of  conscious  patients  during  brain  surgery.  Patients 
rel i ved  earl  i er  periods\or  experi ences  through  moving-picture  fl ashbacks 
These  were  not  dreams  but  sequential  records  of  the  patients'  earlier-v_ 
experiences  reojrded  in  the  br.in.    However,  Piaget  and  InheldfeTi- (4971)  . 
arque  that  visjal  images  recorded  in  the  mind  depend  on  the  active 
coding  and  perceptions  of  tl;ie  subject.    Yuille  and  Catchpole  (1977) 
also  believe  ttet  the  activeV construction  of  images  in  the  mind  plays 
a  role  in  mental  imagery,  tha^^  more  takes  place  in  a  person's  mind  • 
than  jilt  a  recording  of  ext^^^  stimuli.    Naturalistic  inquiry  offers 

.'  \'  •■  260,- 


:.n  alternative  approi^ch  for  the  study  of  mental  imagery  and  problem 
solving. that  ma>  provide  a  more  complete  explanation. 

Rationale  for  Naturalistic  Inquiry 


In  recent  years  there  has  been  a  growing  interest  in  qualitative 
or  naturalistic  methods  of  research  that  involve  watching,  talking 
-W^TstemTTg-to-and-part-ic-ipat-ing-w-i-th-^ubj^^^^^^^  in  nat^jral  settings_ 


Lo  gain  knowledge  of  an  insight  into  human  learning  and  behavior, 
Qualitative  research  allows  for  innovative  styles  c'nd  methods  in  collecting 
broader  explanations  of  phenomena. 

Some  crvcics  have  said  that  qualitative  (or  naturalistic  or 
ethnographic)  research  methodologies  are  less  scientific  and  easier 
to  do  than  quantitative  ones.    In  fact,  qualitative  researcher^  have 
the  same  concerns  about  reliability  and  val idity  that  quantitative 
researchers  have  and,  far  from  being  easier  to  do  than  quantitative 
research,  qualitative  research  can  be  more  difficult  to  do  if  the 
researchers  uphold  quality  standards.    Furthermore,  as  those  in  the 
qualitative  camp  have  cl^arged,  the  qnantitative  research  methods  of 
control  of  specific  variables  and. m^anipulation  of  other  specific  variables 
lead  to  possible  question,  about  external  validity;  that  is,  the  findings 
and  conclusions  of  one  experiment  with  a  selected  group  may  not  apply 
to  another  group. Thus,  both" methods  .of  research 
With  the  limitations  of  qualitative  resea-ch  in  mind,  let  us  look 
at  one  method'in  which  students  attempted  to  solve  problems  through 

mental  imagery- 

In  his  book,  PpH.r^npv  of  the  Qppressed,  Paulo  F-eire  (1970) 
provides  an  JJ^p3e  of  this  naturalistic  approach.    Freire  used  photograph. 
.  with  iUi^jects  to  encourage  dialcgl^^hich .  resulted  in  action  to  bring 
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about  conscienta^ation  in  the  minds  of  oppressed  people.  Inherent 
in  Freire's  approach  is  the  rejection  of  authoritarian  teaching,  a 
feeling  of  trus?:  acquired  through  learners'  participation,  the  seeking 
of  truth  and  a  a^^^^^^^  expression  and  action.    Perhaps  the 

jtaan~as-u^        characterist^ic  that  Guba  and  Lincoln  (1982, 
^TzBsTd^s^rited  could  be  met  by  adopti^^g~tl^^TOi"**e-^TP^^^-^^  — 
Freire-(-WO-)-de-veJ-oped_a_phno^ophy^ 


based  on  the  ctnviction  that  every  human  being  is  capable  of  looking 
critically  at  Ms  or  her  world  in  a  dialogical  encounter  with  others. 
Given,  an  active,  participatory  role  in  his  or  her  education  a  student 
could  perceive  his  or  her  reality  and  be  able  to  deal  with  that  reality 
with  confidence  and  dignity.    The  key  to  the  Freire  (1970)  approach 
is  active,  ratter  than  passive,  involvement  in  learning. 

Participdory  learning  through  mental  imagery  and  problem  solving 
allows  the  nato-alistic^ researcher  to  gain  insights  into  learning  - 
behavior  by  e,=Bnining  students'  sketches  and  discussing  them  with, 
the  students,   -.-dents  often  act  out  or  keep  track  of  their  internal 
thoughts  in  onter  to  solve  the  visual  puzzles  and  verbal  problems 
given  to  them.  Students  can  then  use  these  internal  thoughts  as  data 
to  share  with  .ther  students.    Asking^ students'  to  become  participants 


the  steps  of  i^ntal  processing  that  lead  to  finding^ solutions  to  the 

r 

problems.  .  •  ' 

Mental  Imagery  in  the  Classroom  \ 

*  * 

There  is  a  growing  amdunt^f  research  on  visual izati^on,  mental 
imagery  ancj  relaxation  techniques  that  is^  applicabl'e  for  naturalistic 
inquiry.    So«  researchers  have  u?e1f^the  stress.free  and  fast  learning 
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technique  of  Geirgi  Lozanov  called  suggestology  (Ostrander  &  Schroeder, 
1979).    Suggesttlogy  is  a  holistic  approach  to  learning  that  uses 
relaxation  and  jcnncentration  techniques,  visualization.  Baroque  music 
and  breathing  esercises  to  learn  foreign  languages,  memorize  information, 
improve  self-imfge.  prepare  for  sports  events  and  solve  intellectual 
and  emotion?''  pmhlpm^.    Mmnntnn  (1Q7R)  in  his  book.  Getting  Well  


Again,  describes  how  positive  attitude,  relaxation,  imagery  and  exercise 

"arTlIsecl  foF^treating-cBncer  patients^.^^^^^  (1978) -describes  

how  patients  farm  mental  ^pictures  of  white  blood  cells  killing  cancer 
cells  and  then  carrying  them  out  of  the  body  through  the  liver  and 
kidneys,    in  tte  mind's  eye  the  patients  visualized  the  cancer  decreasing 
in  size  and  the  body  tissue  returning  to  normal . 

Imagery  can  play  an  important  role  in  learning.    Teaching  with 
visualization  oin  help  students  design  materials,  prepare  for  presen- 
tations, understand  and  retain  information  and  gain  control  over  their 
learning.    Visial  thinking  involves  seeing  the  external  world,  making 
visual  represBTtations  of  that  world  and  using  the  inner  eye  or  exercising 
mental  imagery.   Mental  imagery  is  the. ability  to  create  images  in 
the  mind  to  ufdErstand,  remember  and  enjoy  experiences.    We  create  . 
images  in  V^^nnds  to  organize."  simplify  and  explain  our  experiences. 

Our  interpretaitions  of  those  expeHences  are  based  on  our  ^biVity^^^  

to  "see"  external  stimuli  and  use  the  "inner  eye"  to  interpret  our  „ 

world.  ^ 

The  value  of  imagery  is  that  it  can  be  applied  directly  in  the 
classroom       i(Fleming  &  Hutton,  1983).    Problems  and  the  act  of  solving 
problems  are  canmon  experiences  in  the  study  of  all  disciplines.  In 
my  work,  I  plw  to  have  high  school  students  apply  mental  imagery 
in  a  college  reading  course  and  «4file  school  students  to  a  science 
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course,    in  both  cases.  I  pUn  to  Introduce  mental  imagery  and  problem 

solving  into  the  existing  curriculum  and  teaching  practice  with  minimum 

-44.        n;^tMral  setting  of  the  classroom, 
interference  wilh  the  natural  sextmy 


ppcparrh  Possibilities,^ 


--fhe^r.sean.h-on.-nieata_l„imagefv_an^^^^^ 


three  tasic  actWties:    1 .    learning  to  visualize;    Z.    using  images  . 

(internal  and  eternal)  to  solve  problems;    and    3.  usingmental 

rehearsal  to  conduct  science  experim^ts  or  take  tests  in  a  college 

reading  course.. 

I.    Learning  To  Visualize 

The  subjeas  will  see  a  slide  program  as  an  introduction  to 
visualization  a^  will  learn  to  see  and  read  visual  illusions  and 
visual  symbols  *rough  the  slide  program.    The  students  will  also 
,ear„  to  co««ate  visually  through  overhead  transparencies,  .sl.des. 
and  videotapes  they  make.    This  activity  is  called  the  ..participatory 
instructional  fesign  approach..  (Hortin.  1983).  , 

Participatory  instructional  design  means  that  students  become 
involved  in  the  instructional  design  process  at  a  more  intensive  level 
than  Is  usually  th;"caser?art^^TpaSry  desigri^TsHarihrbf  the 

thinking  proces^s  with  the  rest  of  the  class  -  a  ..participation.' 
from  all  who  a.  involved  in  the  experience.    The  students  become 
„  their  own  instn-ctional  designers  and  learn  to  make  their  ideas  visible 
with  materials  provided  by  the  school. 

Here  are  six  steps  that  I  will  ask  my  students  to  use  in  order, 
to  develop  mate-ials  for  the  classroom: 
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1.  Affirm  you  v>-sualization  abilities.  * 

2.  Assume  a  relaxed  state. 

3.  Read  the  prciilem  and  data  you  will  treat. 

4.  >  Visualize  tte  idea,  problem  or  data  (internal  representations). 

5.  Immediately  write  down,  act  out,  record,  sketch,  or  design  the 

images  yea  see  (external  representations). 

6.  Evaluate  the  instructional  materials  as  a  group. 

Also,  I  will  discuss  with  the  students' the  practices  and  research 
on  mental  imagery  of  the  following  authors: 

Arnheim.  R.    Vi'Eual  thinking.    Berkeley  and  Los  Angeles:  University 
of  California  Press,  1969. 

Bry,  A.    VisuaJtzation:    Directing  the  movies  of  your  r-iad.    New  York: 
Barnes  &  Jtoble  Books,  "T978.  >-- 

Edwards,  B.    DrBEwing  on  the  right  side  of  the  brain,    l.os  Ar.qeles: 
J.  P.  Tarcfaer,  1979. 

Gregory.  R.  L.   The  intelligent  eye.    New  York:    Mcliraw-Hir'  Book 

Company f  T970.  ^ 

Hortin.  J.  A.   Visual  literacy— The  theoretical  foup.dal:>r.!  :  :    An  investi- 
gation of  the  research,  practices  and  theorie';  {n-c':oral  dissertation., 
Northern  ffllinois  University,  1980).    Dissert.-  v^n  Abstracts 
,     Internatiamal .  1980.    (University  Microfilms  Nc,  81-1 ' 564) 

Ihde,  0.    Experimental  phenomenology:    An  introduction.    New  York: 
G;  P.  Putnam's  Sons,  1977.  ~ 

Mr  Kim,  R.  H.   .Experiences  in  visual  thinking.    Monterey,  California: 
;  '       Brooks/CiDle,  1972.  ~ 

Patten,  3.  M.   Visually  mediated  thinking:  'A  report  of  the  case  of 
Albert  ETi'nstein.    Journal  of  Learning  Disabilities,  1973,  6' 
(7),  15-na;  420. 

Samples,  R.    Tte  m^^taphoric  mnd:    A  celebration  of  creative  consciousness. 
Reading,  Ifla<ssachus'itts: '  Addison-Wesley  Publishing  Company.  1976. 

Wer,dt,  P.  R.    Sfte  language  of  pictures.    In  S.  I.  Hayakawa  (Ed.) 

The  Use  iaicl  Misur.e  of  Language.    Greenwich,  Connecticut:  sawcett 
PublicatScms,  1962.  / 
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Whimbey,  A.  &  Wiimbey,  L.S.    l^tPHiaence  can  be  t&ught.    New  York: 
Bantam  Books,  1975. 

Wileman,  R.  E.   Fxercises  in  visual  thinking.  ..New  U-k:  Hastings 
House,  TSaO. 

Williams,  L.V.   Teaching  for  the  two-sided  mind,    s^^.glewood  Cliffs: 
Prentice-ttall,  1983. 

i 

Finally,  a  shortened  version  of  the  Betts'  Questior.riaire  by  Sheehan 
(1967)  will  be  given  to  the  students.    This  instrument  measures  a 
general  abilit?  to  image  in  a  number  of  sensory  r^:',r.ariences . 


II.    Using  Images  for  Problem  Solving 

In  the'sacond  activity  I  will  show  students  how  to  use  images 
of  tha  mind  for  problem  solving.    I  want  the  students  to  "see"  situations, 
internalize  visually  the  data  given,  Mevise  ;i  pla-.i  for  finding  the  • 
solution  and  salve  the  problem. 

In  the  i»st  when  I  have  attempted  to  investigate  how  students 
solved  probleiis,  I  found  they  verbalized,  visualized,  added  and  subtracted 
information,  and  recalled  past  experit^ates.    Students  made  internal  • 
representatioms  of  the  puzzles  present-d  to  them  and  then  used  these 
internal  repmentations  for  sorting  through  information,  acting  out 
-situat-onsT-T#.ear-s^ 
in  the  probletP  solving  process.    Students  also  made  external  represen- 
tations of  their  internal  representations.    The  external  representations 
were  symbols  of  the  internal  processing  and  provided  a  record  of  decisions 
made,  of  knowaedge  discovered  and  of  solutions  presented.    These  kinds  . 
of  external  representations  have  the  potential  to  become  records  of 
"  thought  to  stare  with  others  in  the  class;  therefore,  I  felt  it  important 
tostress  to  tte  students  the  need  for  externally  representing  their 
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thoughts  on  the  instruments  provided.    Students  could  then  use  these  external 
representations  to  share  with  others  the  thinking  process  involved 
in  solving  various  problems.    Sample  questions  from  the  instruments 
include  the  following: 

1.  If  Tom  is  shorter  than  Dick,  and  Harry, is  taller  than  Dick.^is 

Tom  taller  or  shorter  than  Harry?    (Albrecht,  1980,  p.  43)      .  • 

2.  My  house  faces  the  street.    If  a  boy  passes  by  my  house  walking 

"  toward  the  rising  sun,  with  my  house  at  hi,s  right,  which  direction 
does  my  house  face?    (McKim,  1972,  p.  15) 

3     A  dwarf  lives  on  the  twentieth  floor  of  a  skyscraper.    Every  morning 
he  goes  into  the  lift  [elevator],  pushes  the  correct  button, 
and  is  taken  to  the  ground  floor;  he  goes  off  to  work  and  comes  - 
back  in  the  evening.    He  enters  the  lift,  pushes  the  button, 
and  goes  up  to  the  tenth  floor;  he  then  walks  up  the  rest  of 
the  stairs.    The" question  is:    Why  doesn't  he  go  up  to  the 
twentieth  floor  in  the  lift?    (Eysenck,  1966,  p.  9) 

Most  students  solved  the  first  question  by  drawing  stick  figures 
and  discovering  that  Tom  must  be  shorter  than  Harry.    The  second  problem 
found  students  drawing  a  map  to  arrive  the  answer  (north).    The  third 
question  caused  students  to  visualize  the  scene  and  see  that  the  dwarf 
cannot  reach  higher  than  the  tenth  button  on  the  elevator. 

Another  instrument  asked  students  to  identify  a  sequence  of 
figures,  perform  closure  exercises,  identify  hidden  figures,  judge 
di-stances-o1^Hnes--and-move-figuFes-in-patter.ns-^-om_one_po^   

to  another. 

III.    Mental  Rehearsal 

One  aspect  of  mental  imagery  that  students  can  find  useful  is 

the  act  of  mental  rehearsal.    Students,  Tike  all  people,  often, think 

about  the  consequences  of  certain  behavior  and  decide  for  or  against 

2oO 


267 


9 


that  behavior.    Since  they  are  accustomed  to  this  process,  students 
can  learn  to  use  images  or  scenes  in  the  mind  to  help  them  make  decisions 
and  plan  their  school  work.    For  instance,  in  my  future  research  I  • 
plan  to  have  the  science  students  mentally  rehearse  their  experiments  _ 
before  they  perform  them  and'to  have  the  students  in  the  reading  course 
practice  mental  rehearsal  before  taking  a  test. 

I  believe  that  experimental  research  is  limited  in  describing 
and  documenting  comprehensively  the  imagery  process  and  subsequent 
learning  behavior.    A  well  thought  out  research  plan  involving  both 
experimental  and  naturalistic  methodologies  is  the  best  approach. 
The  intention  of  this  paper  was  to  share  some  activities  for  possible 
research  with  the  mental  imagery  process  that  involves  participation 
by  students  in  a  natural  setting. 
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In  my  presentation,  I  will  be  dlscuBGlng  work  done  for  my  dissertation  on^ 
structural  aspects  of  television  messages.    I  will  provide- a  brief  overview  of 
the  theory  that  underlies  my  study  and  a  slightly  less  bri'3f  oveiView  of  my 
methodology,  and  research  tools,  which  I  believe  will  be  of  interest  to  anyone 
doing  observational  research.    I  will  conclude  with  a  mention  of  preliminary 
results  from  my  study  and  recommendations  for  future  research.  ^  \ 

'I     •  •  '  .  , . .  ^  _  

The  main  focus  of  my  work  is  the  interaction  between  structure  and  content 
in  the  creation  of  meaning.    Current 'theory  in  our  field  holds  that,  ideally, 
the  medlim  chosen  to  teach  must  match  with  the  information  and  task  to  be  ' 
learned,  and  with  the  student  doing  the  learning.    It  is  the  structural 
characteristics  of  a  medlm,  its  particular  formal  means  of  communicating,  that 
helps  to  decide  if  it  is  used.    Thus,  for  example,  if  film  or  video  is  chosen, 
that  decision  should  be  based  in  large  part  on  their  structural  elements,  that 
Is,  on  their  ability  to  show  motion,  juxtapose  Images,  portray  action  from 
various  angles  and  distances,  and  so  on. 

Gavrlel  Salomon  has  done  very  Important  work  In  this  .area,  found  partic- 
ularly in  his  book.  The  Interaction  of  Media,  Cognition,  and  Learning.  Salomon's 
own  experiments  and  others  that  he  draws  upon  show  that  the  structural  charac- 
teristics of  a  medium  interact  with  the  content  of  a  message  and  ultimately 
affect  meaning.    For  example^  Salomon  found  that  the  structural  element  within  . 
film  and  video  whereby  the  camera  zooms  Into  a  detail  within  a  lai^ger  >Jhole 
conveyed  different  information  than  the  came  content  presented  using  other 
formal  characteristics,  such  as  cutting  from  the  whole  image  directly  to  the 
detail. 

Salomon  concludes  that  ^ructiaral  characterlotic.s  csui  act  as  both  carriers 
of  information  and  as  irformation  in  their  own  right.    Calvin  Pryluck  is  also 
interested  in  the  f orm  v>f  media  in  his  book,  SQWceR  of  Heanins  in  HQtjpn  PrWvorep 
^nf?  Television.    He.  concludes  that  meaning  derives,  first;*from  the  L.trinsic 
properties  of  yhat  Is  recorded  by  a  camera  —the  thing  In  the  worldi  second;, 
TOea^-n^-comes  -from-the-^waysTrln-whlch-that-thing^ls  -pho   z 


the  use  of  structiiral  elements  in  its  presentation;  and,  third,,  meaning  derives 
from  the  Interaction  between  this  content  and  form. 

An  example  of  the  Interaction  between  structtrre,  content,  and  meaning 
should  make  this  clearer.    Imagine  a  film  designed  to  develop  young  . children's 
self-esteem  and  self-image.    Depending  In  part  upon  how  the  content  is  struc* 
t;rrally  presented,  the  film,  may  or  may  not  achieve  its  goal.    For  instanced  if 
the  children  within  the  film  were  always  photographed"^ from  a  high  angle,  as 
they  are  normally  seen  ly  adults,  the  aim  of  Improving  the  self-esteem  of  young 
viewers  might  be  jeopardiz;ed.    That  is,  while  the  film  aims  to  make  the  audience 
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of  children  feel  like  Important  individuals  in  their  own  right,  the  particular 
f ornial  element,  of  a  high  angle  lo  implicitly^  showing  the  children  within  the 
film  ac  small  and  Inoignif leant  compared  with  adults.    Thuc,  a  structural  choice 
within  the  presentation  of  the  film. may  relay  a  message  to  the  young  viewers 
that  c6nfllcts  with  what  the  film  wants  to  say. 

'  This  example  points  up  both  the  Importance  of  studying  the  structure  of 
messages  and  how  structure  affects  meaning.    Research  Into  how  form  actually 
affectcs  meaning,  however,  has  neither  been  extensive,  nor  in  complete  agreement.- 
Most  studies  on  formal  elements  such  as  camera,  angles  do  indicate  an  interaction  .- 
"between  structure  and  content  in  visuals.    Unfortunately,  such  research  has  only 
looked  at  single.  Isolated  elements  withottt  regard -to  the  other  struttural 
characteristics  at  work  in  message|3.        ■«  ^~ 

^In  my  research  I  wanted  to  examine  certain  of  the  tiost  .important  structural 
elements  within  televised  messages,  both. as  they  were  Individually  used,  and  as 
they  combined  together.    A  second  concern. was  to  determine  if  these  elements 
were  used  consistently  in  the  same  way,  or  if  they  changed  over  time.    The  'conr 
sistent  use  of  formal  elements  within  the  presentation  of  the  same  content  is,  I 
believe,  fundamental  to  the  Impact  of  that  structure,..   In  the  example  of  the  film 
to  build  Eelf-este,em,  tlie  strengrth  of  the  negative  message  being  sent  to  a  young 
audience  would  seem  to  depend  upon  whether  that  message  was  reinforced  by  struc- 
tural characteristics  other  than  the  camera  angle,  by  whether  similafvpr  different 
messages  were  presented  within  other  sources,  and  by  the  length  of  ,tlme\over  ■ 
which  the  children  were  exposed  to  the  negative  message.  - 

This  examination  of  structural  elements  formed  the  first  part"  of  my  study, 
and  was  based  on  quantitative  data  recorded  during  an  observational  analysis  of 
videotaped  messages.    The  second  part  of  my  study  was  to  see  how  that  form  , 
Interacted  with  the  content  of  those  messages.    This  part  of  my_analysis  could 
not  be  done  using  a  quantitative  methodology,  but  only  through  a  qualitative 
examination  of  how  the  form  and  content  interacted  to  create  meaning.    For  both 
the  quantitative  and  qualitative  ssectiuns  of  my  study  I  relied  on  the  research 
mentioned  earlier.    For  the  most  part,  however,  my  theoretical  base  and  method- 
ology derived  from  semiotics,  which  I  will  discuss  shortly. 

As  ray  sample  I  chose  five  years  of  television  news  coverage  by  all  three 
commercial  networks  on. the  fighting  in  El  Salvador.    The  news  stories  in  my 
sample  totaled  137,  with  a  total  time  of  2  hours  and  48  minutes.    The  news 
_ reports  were_c(>mplledJby_the--Vanderbllt_-Unl-verBlty-Televlslon  News  Archive.  „ 
This  choice  of  sample  material  came  from  an  Interest  In  the  formal  aspects  of  - 
television,  particularly  television  news  reporting,  and  from  the  ability  of  such - 
a  sample  to  provide  a  series  of  messages  on  the  same  general  topic  spanning  a 
considerable  length  of  time.'  This  allowed  an  investigation  of  how  structural 
elements  were  used  at  any  one  time  and  over  a  five  year  period. 

Turning  now  to  semiotics,, I  can  provide  only  a  very  brief  introduction  to  - 
this  complicated  subject.    The  concern  of  semiotics -Is-signs  and  the  codes  used 
to  organize  those  signs.    A  sign,  according  to  Charles  Pelrce,  an  early 
semloticlan,  is  anything  that  "stands  to  somebody  for  something  in  some  respect 
or  capacity."  (quoted  in  Hawkes,  1977*  126)   Thus,  a  word  is  a  sign,  as  is  a 
picture.    Television  messages  are  composed  of  a  multitude  of  different  signs. 
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organized  through  various  codes.    Codes  act  something  like  a  grammar  within  a 
medium.    For  example,  within  film  and  video  there  exist  codes  related  to  editing, 
as  In  the  use  of  a  dissolve  to  Indicate  that  time  has  passed  l)etween  two  shots. 
'Codes  are  Involved  both  In  how  signs  are  put  together  to- make  sense  and  In  how 
they  are  Interpreted.    My  study  focused  on  the  Initial  part  of  this  communication 
process,  on  how  structural  elements  were  used  l?y  newsworkers,  those  decisions 
being  a  product  of  different  codes,  and  how  that  usage  Interacted  with  the  con- 
tent to  affect  meaning. 

•  The  first  section  of  my  study,  then,  was  to  observe  and  record  formal  char- 
acteristics in  a  sample  of  news  stories,  primarily  in  the  visual  track.    I  was 
mainly  interested  in  how  the  strusture  of  visuals  affects  meaning;  the  structure 
of  the  aural  track  would  be  studied  only  in  how  it  interescted  with  the  images. 
As  to  th*  particular  formal  characteristics  chosen,  I  relied  on  information  about 
general  newswork  routines  and  on  film  theory  and  practice.    The  elements  were 
grouped  under  the  code  that  determines  their  usage.    For  example,  it  is  a  code  of 
editing  that  decides  whether  two  images  will  be  joined       a  cut  or  a  wipe.  Cer- 
tain elements  were  further  clarified,  such  as  that,  pans  were  to  the  left  or  right, 
and  tilts  were  up  or  down.    A  partial  list  of  the-  main  formal  elements  studied 

follows I  ,  .V 

Editing  (cttts,  dissolves,  wipes; 

Camera  Worki 

,      -  Angle  (high,  low,  eye-level) 

Movement  (pan,  zoom,  track,  tilt) 
Distance  from  camera  to  subject 
Visual/Aural  combination  (e.g.  a  voice-ovrer) 

Kow  these  formal  characteristics  were  used  within  my  sample  of  news  stories 
was  one  focus  of  inquiry.    Squally  important  was  how  these  elements  interacted 
•  with- the  content  of  the  reports  to  produce  meaning,  requiring  that  a  cf^taln 
amount  of  information  about  what  went  on  in  the  stories  be  recorded.    Using  the 
shot  as  my  basic  unit  of  analysis,  I  collected  data  about  the  main  subject, 
action,  and-  location  of  each  shot.    The  particular  categories  within  subject, 
action,  and  location  came  from  ray  own  interests  and  from  what  was  found  in  the 
sample.    I  viewed  approximately  one-third  of  the  news  stories  to  determine  if 
the'  particular  structural  eleraents  and  content  categories  chosen  were  actually 
being  used.    Minor  adjustments  were  made  on  the  basis  of  what  I  found. 

Turning  now  to  the  actual  recording  of  the  data  from  the  videotaped  stories, 
it  is  obvious  that  I  wanted  a  great  deal  of  information.    I  also  wanted  to  record 
it  in  the  same  sequence  and  temporal  order  as  it  occurred  in  the  reports.  For 
example,  I  wanted  to  be  able  to  record  that  the  anchor  spoke  for  ten  seconds, 
..  then  a  reporter  began  a  voice-over,  while  four  civilians  carried  a  coffin  in  a 
five  second  shot,  and  so  on. 

To  accomplish  such  data  collection  by. hand  would  have  been  prohibitively 
'  time-consuming.    Luckily,  from  Work  done  on  video  narratives  by  Professor  Ann 
Becker  at  the  University  of  Wisconsin-Madison,  I  was  aware  of  a  set  of  tools  that 
can  be  used  to  efficiently  and  with  amazing  detail  record  observational  data. 
These  tools  were  developed  by  Gordon  Stephenson,  also  at  Madison,  initlallor  for 
field  observation  of  animals.    Information  about  a  situation  is  entered  onto  a, 
portable  keyboard  that  sends  it  via  a  short  cable  to  a  cassette  tape  recorder. 
'  vmen  filled,  these  tapes  are  decoded  V  a  computer  where  the  data  is  checked  for 
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errors  and  undergoec  statistical  analysis.    Stephenson  also  had  plans  adapt 
hircompSer  programs  for  use  on  an  IBM  personal  computer  and  ^ 
a  ^rtable  microcomputer  using  micro-cassettes  for  the  more  bullcy  keyboard  and 
-  caoeette  recorder.  i  \  . 

Before  taking  any  data,  the  reseaircher  muU  carefully  define  the  situation 
to  be  obB^ed,  ?f coding  tiat  Information  in  a\ computer  program  called  Plexyn. 
This  is  a  Smplex  prccesf ;  put  very  simply,  the \re searcher  must  decK^e  on  the 
dynamics  wuSln  Jhe  observallonal  situation,  the\  logic  that  underlies  it,  and 
dynamics  f        .     viexvn.    Plexyn  then  uses  that  Information  to  check  the 

Teo^i^'erdaf/r/™  SvS  a  SlSy  detailed  description  of  the  .lsta,«s 
it  encounters.  .  . 

In  the  process  of  recording  data,  the  researcher  follows  a  form  of  e..try 
o"S£    ai!^^^^^  iraSr^eiTn 

the  subject  and  object  in  relation  to  the  observer  and  to  each  other,  and  mod 
Ifiers  can  be  added  for  even  more  data. 

ThP  data  is  entered  in  brief  letter  and  nuiaber  codes  whenever  an  action 
occurr      or  ?he  sUulSon  under  observation  changes.    For  example,  folic  .ing  are 
  Z^^es  ?^m  my  study  of  coded  entries  and  their  English. equivalents. 

IR-Z;^  The  anchor  reports  to  the  camera  in  a  medim  shot  (includes  the  ■ 

head  and  torso)  .  ,4.u^»,  +ko 

lfM-2@t^J  A  government  soldier  moves  right  in  a  medium  shot  within  the 

7956  sr-6@7VS    Fivr^illians  stand  facing  left  on  a  village  street,  in  a 
long  shot  (includes  the  entire  body;  ' 

rn:fltrile  \TZ.  J.oZ.  l^^ll^ess  of -the  data  one  Is  able  to  record  ,ulc.ly 
and  in  having  an  error-detector  for  that  data  as  well.  : 

nncP  data  is  gathered,  the  tapes  are  decoded  on  a  Computer  and  the  resulting 
outpu?  contains  descrilpti^ns  of  a^  errors  made,  Vhlch  can  then  be  edited  out. 
?.Vn!?lv    f  statistical  program  is  used,  offering  such  information  as  total 
^"Seniles  and  d^Slon^^B  well  as  high,  low,  and  average  d^ation    and  the 
SrSl'  o?  the  total  time  taken  up  by  each  variable.  .The  data  collected  can 
also  be  analyzed  using  other  computer  programs,  such  as, SPSS. 

I  am  currently  in  the  process  of  working  through  the  enormous  amount  of  data 
from  Jy  obs^aJloLl  study!    To  touch  on  only  one  structural  element  analyzed, 
irom  my  .  ^oth- similarities  ..and -differences  among  the  three 

n:?;ork^     ?o?;xLple!  irhartiJe  clLnera  either  pan,  zoom,  track,,  or  tilt 
Pve^^lSie  Ind  o^^alf  seconds,  while  CBS, -and  NBC  use  camera  movement  about 
eveS  Sn  seconds!    More  specif ically,  ABC  and  NBC.  use  the  same  number  of  zooms, 
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Hhllp  CBS  uaeo  more.    How  these  zooms  are  used  within  the  news  stories  is,     how-  - 
ever,  similar  across  the  three  networks.    Generally,  a  zoom  In  focuses       «^ sub- 
ject of  a  shot,  or  on  a  symbolic  detail,  such  as  a.-bombed  building  or  a  leftist^ 
banner.    Zooming  fi^t  involves  the  opposite  process  as  the  camera  first  focuses  on 
a  detail  and  then  widens  out  to  place  it  into-  context.    The  basic  question  of  my 
study  is  what' effect  does  a  structural  element  such  as  a  zoom  in  or  out  have  on 
the  particular  content  It  conveyes.  , 

Thus,  my  study  moves  from  a  quantitative  analysis,  of  the  use  of  formal 
elements  within  the  news  reports  to  a  qualitative  ^"I'.^^l^^^ 
acteristics  interact  with  the  content  they  convey.    It  is  in  this  interaction 
between  form  and  content  that,  as  Pryluck  concludes,^  meaning  arises.    To  analyze 
this  interaction  I  relied  upon  semiotic  theory,  particularly  on  the  concepts  of 
denotation  and  connotation. 

•  These  twin  concepts  involve  how  form  and  meaning  operate  within  messages. 
Very  simply  put,  every  message  has  two  levels  of  meaning,  the  denotative  and  the 
connotative,  which  are  inextricably  intertwined  for  receivers  of  messages.  The 
denotative  level  includes  the  overt  form,  content,  and  meaning  of  a  message.  For 
example,  a  picture  of  a  child-on-the~denotative-level-raean8-simply  that_partlcula2^_ 
child,  at  that  particular  point  in  time.    Connotative  meanings  derive  ft^om  the 
denotative  level,  but  are  more  diffuse  and  covert.    Connotations  result  from  the 
interaction  of  form  and  content  on  the.  denotative  level.    For  example,  if  the 
Dlcture  of  the  child  is  taken  from  a  hi|h  angle,  the  connotations  will  be  different 
from  those  in  a  picture  of  the  same  child  taken  at  eye-level.    The  Prlm^ 
theorist  in  semiotics  to  advance  the  Idea  of  connotations  was^ Roland  Barthes, 
although  the  general  concept  of  implicit  meaning  is 'widely  held  within  media 
criticism. 

The  leap  from  statistical  data  drawn  from  observation  to  interpretation  of 
implicit  meanings  may  seem  a  fairly^ precarious  one.    Within  semiotic  .theory,  how- 
ever, it  is  not  only  justifiable,  b'ot  necessary  to  examine  both  levels  of  meaning  , 
that  CO  to  make  up  the  total  meaning  of  a  message.    Semiotic  theory  holds  that 
these  two  levels  are  Inseparable,  are  two  levels  of  the  same  phenomenon  and  there- 
fore must  both  be  studied.    My  study  assumes  that  examining  messages  both  quan- 
titatively and  qualitatively  Is  more  complete  and  fruitful  than  using  either 
methodology  alone,  offering  a  richer  analysis  of  the  interaction  of  form,  con- 
tent, and  meaning.  '  , 

In  conclusion,  I  would  like  to  point  out  that  my  study  Is  only  the  first 
part  of  a  truly  complete  analysis  of  how  structural  elements  function  and  their 
effect  on  meaning.    It  Is  also  necessary  to  study  audience  reaction  to  these 
eleftfents  and,  in  doing  so,  attempt  to  take  into- account  all  levels  of  meaning 
Inherent  in  messages.    In  addition,  a  concern  for  the  Implicit  meanings  within 
media  as  a  function  of  form  is  not  the  province  of  theorists  -and  researchers 
alone.    If,  as  I  have  argued,  meaning  ia  affected  by  the  Interaction  of  content 
and  form,  then  we  as  educators  must  be  as  aware  of  the  form  ^f  a  message  as  we 
are  of  its  content. 
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The  widespread  use  of  micrpcomputers  in  sch';.: 
the  first  part  of  this  decade  signalled  a  new 
computing  research.  Before  this  movement,  r:  . 
computer-based  instruction  were  limited  to  Ir. 
centralized  projects  such  as  the  Stanford  m.'t 
(Fletcher  &  Atkinson,  1972;  Suppes  &  Mbrnino tai: , 
Curriculum  Corporation ,    (Lysiak ,  Wallace  &  Evah^^ , 


which  Degar  "'n 
?ra  fbr  educal  ;'  j*.i<ul 

studies  of 
-^e-  scale , 
and  reading 

1972)  ,  Computer 
1976;  Crandall/ 


1977;  Holland," 1980) ,  Control^Data  PLATO   (Alessi,  Siegel,  Silver 
&  Baines,   1982-83;   Poore,  Quails  &  Brown,   1981;,  and  TICCIT 
(Jones,   1978)   programs.     These  studies  were  usually  performed  by 
grant-funded  projects  with  a  research  and  evaluation  component 
built  into  them.     But  with  the  acceptance  of  lew-cost  computing^ 
in  schools  and  the  explosion  of  n^^'W  computer-based  materials^  the 
opportunities  for  research  in  this  area  have  .greatly  expanded  and. 
changed  in  nature.     Small  school  and  classroom-based  prograras 
have  been  started  throughout  the  country.     Not  only  do  studies  of 
these  programs  have  the  potential  for  making  a  significant 
contribution  to  the  field,   they  are,   in  tact,  essential  if.we  are 
to  make  any  progress  in  establishing  the  usefulness  of  new 
computer-based  methods  ar.^-  materials. 

However,  since  the  focu:?  of  these  educational  computing  projects 
is  often  implementation  richer  thai  research,  at  least  two 
factors  are  likely  to  iniuibit  systematic  studies  of  their 
activities.     First,  there  are  practical  difficulties  in  arranging 
research  studies  with  the?  traditional  randoraized  two-group 
designs  in  these  settings.     Secondly,  project  perr;5onnel  usually 
lack  the  expertise  to  employ  other  effective  designs  and  ^-nalyze 
the  resulting  data.     If  we  are.  to  take  advantage  of  the  valuable 
information  available  from  classroom  computer  projects, 
alternative  designs  to  study  computer-based  activities  mast  be 
employed,  and  "cookbook/'  data  analysis  methods  for  each  design 
must  be  made  widely  available.     This  paper  will: 

•  present  five  designs   (three  one-group  and  two  two-group) 
which  can  be  effectively  employed  to  study  computer-based  irethods 


"v7fieh~"a  randomized  two-group  experimental  design  is  not  practical, 

•  For  each  design,  give  examples  of  research  studies  whi  h 
effectively  employ  such  designs, 

•  supply  example  utility  programs  ^nd  procedures  which  can 
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be  used  by  persons  with  limited  training  in  statistics  and 
research  methods  to  analyze  data  resulting  from  these 
non-traditional  designs^  and  finall}'r 

•  Give  a  decision  flowchart  and'  ^.escribe  how  to  select  the 
most  appropriate^inon- traditional  design  for  one's  project. 

FIViE  NON-TRADITIONAL  RESEARCH  DESIGNS 
Design  #1;  Sequential  Analysis 

Sequential  analysis  techniques  originated  almost  forty  years  ago 
(Wald^  1947)^  but^  with  few  exceptions^   they  have  been  used  for 
quality  control  of  products, rather  than  to  analyze  results  of  • 
research  studies.     However,  they  can  also  be  u..9ed  to  construct  an 
effective  behavioral  research  design.     In  such  studies,  all 
sequential  analysis  techniques  would  empl  oy  the  same\  s trat*^gy: 
(a)   an  observation  would  be  made   (e.g.  one  or  mor^  t^tudents  are 
tested  on  some  skills),    (b)   the  .results  are  recorded  ok  a  chart 
or  graph  developed  for  this  purpose,  and   (c>  by  reading  the 
chart,  a  decision  is  made  to  accept  the  null  hypoirhesis,  to 
accept  an  alternative  hypothe^^i^  or  to  make  anothet  observant  ion .. 

This  technique  has  many  advantages  for  ccmput':'r-ba.  ed  studies  ;^ 
besides  not  requiring  a  control  group.     Its  c>rincipax  advantage^ 
is  efficiency.     As  a  sampling  technique^,   it  can  allow  de'-iisions  \ 
to  be  made  with  as  much  as  50%  fewer  observations  than  would  be 
required  for  procedures  \n  which  sample  size  must  be.  specified  iri 
advance.     This  makes  it  an  ideal  choice  whan  the     imber  of  people 
which  can  be  tested  on  the  materials  is  limited  by  ^actors  such 
as  the  number  of  computers  avai labile  or  by  coiv- trair.ts  such  as 
not  being  able  to  "get  the  whole  student  group  at  one  time  or  tbo 
expense  of  the  treatment . 

There  are  some  limitations  on  when  it  can  be  effectively  used . 
Since  there  is  no  control  in  this  design  for  prie^:  learning,  it 
is  better  to  use  it  when  there  is  little  likelihood  that  students 
would  be  able  to  do  the  skills  involved  before  exposure  to  the 
materials,  as  with  programming  concepts  or  verbal " information  , 
drill  such  as  ino  social  studies  or  history,   'it  is  also  di^sirable 
that  the  skill  units  be  relatively  short,   to  cut  dowrr,  on  effects 
due  to  maturation  anc^  history   (Campbell  and  Stanley,  1963).  If 
the  materials  under  study  are.  lengthy,  they  can  be  divided  up 
into  short  units,   and  a  sequential  analysis  can  be  dope  on  ^arh 
one•^,  This  technique  is  also  most  useful  when  teachers  want  tc 
make  an  absolute  judgement  about  materials   ("Are  these 
computer-based  lessons  effective?")   rather 'than  a  comparative  one 
("Are  these  lessons  better  than  non-computer  lessons?") 

Example  of  sequential  analysis  use.     A  typical  study  using 
the  sequential  analysis  method  is  currently  being  undertaken  by 
the  U.  S.  Army  to  evaluate  the  effectiveness  of  o 
microcomputer/videodisc  training  ^aaterials.       The  modules  were 
designed  to  teach  specialist  students  to  perform  a  lengthy  and 

262 

27a 


Practical  Strategies   ...    (King  &  Roblyer  )  Page  3 

expensive  procedure  for  testing  the  purity  of  jet  fuel.     No  other 
training  is  currently  being  given,  so  no  control  condition  is 
available.     Effectiveness  is  to  be  defined  in  terms  of  the 
oroportion  of  students  who  successfully  complete  the  simulated, 
task  in  no  more  than  two  trials.     Based  on  the  experience  of  the 
faculty  of  the  school  in  training  similar  students  on  similar 
tasks,   that  proportion  is  determined  to  be  at  least   .80.  After 
this  proportion  is  set,   the  following  steps  are  to  be  completed: 
/  ■  . 

STEP  1;   Setting  acceptable/unacceptable  quality  levels  - 
Since  absolute  accuracy  in  judging  instructional  quality  cannot 
be  achieved  with  a  sampling  technique,  the  success  proportion 
(.80). must  be  translated  into  a  range  of  proportions  which  define 
acceptable  and  unacceptable  instructional  quality.     In  this 
instance,  the  range  is  set  at  .80  plus  or  minus  .10.  The 
Acceptable  Quality  Level   (AQi:)   or  the  proportion  of  the 
population  which  indicates  acceptable  quality,   is   .90.     If  90%  or 
more  of  the  students  -in  the  popul:ation  can  meet  te  success 
criterion,   the  instruction  is  considered  to  be  of  high  quality  , 
and  accepted  for  routine  use.     The  Rejec.table  Quality  Level  (RQL) 
or  the  proportion  of  the  population  that  indicates  unacceptably 
low  quality,   is   .70.     This.means  that  if  only  70%  or  fewer  of  the 
students  can  meet  the  success  criterion,   the  instructional  is,o 
rejected  as  unacceptable.'   If  the  proportion  alls  between  .'70  and 
.90,   the  instruction  is  of  questionable  quality. 

STEP  2;   Setting  risk  parameters  and  proportions  -  The 
probablity  of  rejecting  high  quality  instruction   (alpha)  and  the 
probablity  of  "accepting  low  quality  instruction   (beta)  must  be 
set      Because  obtaining  ^high-quality  instruction  is  very 
difficult,  the  probability  of  rejecting  wrongly  it  must  be  very 
low,   thus  alpha  is  set  at  .01.     Mistakenly  accepting  low  quality 
instruction  for  quality  instruction,  is  not  deemed  to  be  very 
serious  because  it  can  always  be  remedied  later,   thus  Beta  is  set 
at  .10.     One  more  calculation  is  necessary.     Since  sequential 
analysis  was  originally  designed  "to  detect  proportions  of 
defective  units,  p(l)   and  p(2)  must  be  calculated,  respectively, 

as  1-AQL  and  1-RQL.  "  . 

t,  -  f 

STEP  3;  Construct  Operating  Characteristics  Curve   (PC) ^ 
.Average  Sample  Size  Curve   (ASN)   and  truncation  number  -  Now  we 
have  all  the  values  tg  construct   (a)   an  OC  Curve,  which  will  show 
the  probability  of  rejecting  tfr  accepting'  the  null  hypothesis  for 
any  true  value  of  the  success, proportion  under  consideration 
(given  the  specifications  of  the  test),    (b)   the  ASN,  which  gives 
th°  average  number  of  observations  needed  to  reach  a  decision-  for 
any  true  value  of  the  success  proportion  and   (c)   the  truncation 
number  ,,  which  is  the  largest  sample  size  that  could  be  needed  to 
make  a  decision  withou't  altering  the  risks,  the  experimenter  is 
■     willing  fco  accept.     Figures  1  and  2  illustrate  the  OC  and^ASN 
curves  with  , sample  data.     The  truncation  number  is  113.  The 
slope  and  intercepts  for  the  lines  in  the  ,f igures ,   as  well  as  the 
truncation  number,  ^re  calculated  from  the  values  derived  or  set 
in  Step  1  above.    (For  further  directions  on  hoy?  to  calculate 
values,   see  Wald   (1947 ),  Bur?   (1980)  or  Epstein  (1979). 
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[Figures  1  and  2  about  here.] 


Figure  1     (the  OC)   shows  that,   for  very  high  quality  instruction 
(p  <.10)/  the  probability  is  almost  1.0  that  it  will  be  accepted 
(i.e.,  the  null  hypothesis  that  p  >   .30  will  be  rejected)..  For 
very  low  quality  instruction   (p  <  .30)   the  probability  of 
rejecting  the  null  hypothesis   (i.e.,  accepting  the  instruction) 
drops  from  .10  to  almost  zero  as  p  increases.     For  values  of  p 
between  .30  and   .10,   the  probability  of  rejecting  the  null 
hypothesis  varies  from  .99  to  .10.     If  the  population-proportion 
is  .20   (1-.80),  for  example,  the  probability  of  rejecting,  the 
null  hypothesis  is  about  .&4.. 

Figure'  2   (the  ASN  curve')   showc  that  the  largest  average  number  of 
observations   (38)   required  for  a  decision  to  be  made  occurs  when 
the  population  proportion   (p)    is  equal,  to  .20.     As  p  varies  on 
either  side  of  v20,   the  ASN  decreases.     The  truncation  number 
represents  the  vForst  possible  case  in  which  113  subjects  would  , 
have  to  be  observed  before  the  null  hypothesis  would  be  accepted 
or  rejected. 

STEP  4;  Construct  graph  for  recording  observations.  The 
graph  for  recording  observations  contains  three  zones 
corresponding  to  the  three  possible  decisions  which  are 
considered  each  time.,  an  observation  is  made   (to  reject,  accept, 
or  take  more  samples).     The  actual  decision  choice  is  deteijftiined 
by  the  pattern  of  recorded  data.     A  graph  of  sample  '"data  is  shown 
in  Figure  3.  " 

[Figure  3  about  here.] 


The  data  were  place'd  on  the  graph  in  the  following  way.  The 
first  'student  is  tested  and  if  the  student  passes,  a  line  is 
drawn  horizontally  from  0  to  1.     If  the  student  fails,  a  • 
horizontal  line  is  constructed  from  0  to  1  and  a  vertical  line 
drawn  from  1  to  1.     Both  points  are  in*'the.zone  labeled  "continue^ 
sampling,"  so  anothe'r  student  is  tested  and  the  results  placed  on 
the  graph  in  the  same  way.       This  process  continues  until  either 
the  bottom  line  is  crossed  and  the  decision  is  made  to  accept  the 
instruction   (reject  the  null  hypothesis),  or  the  upper  diagonal 
line  is  crossed  and  the  decis  on  is  made  to  reject  the 
instruction   (accept  the  null  Hypothesis).     If  sampling  continued 
until  the  truncation  number  was  reached,  the  instruction  would  be 
accepted  if  the  last  point  were  nearer  the  bottom  diagonal  than 
the  top  diagonal,  or  it  would  be  rejected  if  the  opposite 
prevailed.     In  Figure  3,  the  first  eight  students  passed,  the 
ninth  failed,  the  next  six  passed,  and  the  decision  was  made  to 
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accept -the  instruction. 

^^..^..^        ^r.  ..^nential  analysis  calculations  A^^ility 

lines  of  the  acceptance/rejection  regions. 

'.rr^.b'irofia^uerorthe  coordinates  to  plot  an  OC. 
Vr  A  tabi:  of  vaiuls  of  coordinates  to  plot  an  ASN  curve. 

Design  #2;  value-added  Analysis 

-r^ItateS  ^^^^^  growth!  ^SLS^foSth  (Isti.^tea  fro.  a  , 
completed, 

.any  co.puter-based  -eat.ents  deal  wit.  su|h^^ 

and  writing  s^^^^^'  ^sl  of  lools  like  LOGO.     Study  of 

problem-solving  f^^^        ^^^°^g^eauL  treatment  must  extend  over  a 
such  treatments  is  difficult  JJ^''"^^        j^le  differences  to  occur, 
„      long  period  of  time  in  ^f'^J^^^^jf  due  to  maturation  and 

giving  rise  to  the  P°^^^^^^i^^°^3  is  ideal  for  research  into 
•         ?i:re^Iong-ferrartIvftfes^s?i?r  it^control^  for  these  effects. 

certain  conditions  musl,  f  .^^Xfrror  ^  (  i""e . 'Sh?rnofogical  ' 

variable'  which  can  be  measured  without  ^^^°^,^t4d  with  pretest- 

over  the  school  year       Several  measures  were^ 

skill  levels,   including      N°"^j;^^^^°^^^te3ts  olthe  California 
^^'r'/ra°siriknrs'''Thrva  re^adLra^a^ylis  was  us.d  with  the 
Test  of  Basic  Skills.     The  ^^^hods  for  the  other  test ^will 

rdtscSsseflatefundefanXther  design.)  The '  following  steps.  . 
were  completed:  .  * 

'    STEP  X:  Estimate  of  growth  rate.  First,  an  unbiased 
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following  formula:' 

Q    =    y      +  b(a    -  a\) 

-   1    ,  2  1\ 

where  yd)   is  the  pre  test  mean  and  a  (2)     and  a(l)     are  the  ages 
at  pre  and  post  test  times. 

'    .  STEP  2-  r.i  ornate  value  added.  Use  the  following  fo^''";^?;^ 

to  determl^^  effect  ot  the  treatment,  taking  into  account  the 
natural  growth  of  students  over  time: 

V    =    y      -  G 


2  ■  .  \ 


v^here  y(2)    is  the  post  test  mean. 
Unfortunately/n.  testof^the  significa^^ 

Bryk  et  al.    (1980)  5°-^^^  Jo^providS  a  test^ 

(Hosteller  and  Tukey,   1977)   can  ^e  useu  t     f  ^o-value  (V*i) 

•statistic.   It  involves  the  ^°";Pf^^;°"°^_%SeIe  values  as  data 
for  each  individual  in  the  sample,  ^^"^^^^^  J^^ors.     The  mean 

points,  and  calculating         -  -an  and  standard^err  ^^^^^^  ^^^^ 

is  an  unbiased  estimate  °f  ^^ana       ^       significance  testing  or 
calculation  of  f.t-test   (or       n     f  ^      yielded  the, 

interval  estimation.     in  the  K-i  stuay,  y 
following  results:  "  ' 

V    =  35.3     -     21.3     =  '  14.00 


D  .<  .05 


t  ratio  =  5.36 


TO  increase  the  P-=i-°VL'S'lo"in=i;por^^e'ba=i,riu^d' 
describe  how  it  can  be  ^^'^^^^t^*^?  '^J- aSargrowth  rates.  This 

ItlTrt  tesi-rp  an    the  first  order 
intelabtions  o£  age  and  each  background  variable. 

nrocedure        .lo  calculations.  The  listing  of  an  SESS 
progr^to'^dC  Jhe  Love  cal.4,ia Lxuu.  x.  shown  xn  .ppendxx  B.  . 
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Design  #3;  Non-equivalent  Dependent  Variables 

This  design  involves  one  group  of  subjects  to  which  two   (or  more) 
variables  are  administered  as  pretests.     Performance  on  one  of 
the  variables  is  expected  to  change  as  a  result  of  a  treatment, 
while  the  others  are  not  expected  to  change  (Cook  and  Campbell, 
1979).     Such  an  approach  has  two  advantages.     First,  no 
non-treatment  control  group  is  needed,  sinue  performance  on  one 
varial^le  acts  as  a  control  for  the  other.     Second,  older  students 
can  be  used  since,  unlike  the  value-added  analysis,  no  . 
independent  'variable  such  as  age  is  required.     The  basic  design 
is  diagrammed  as:  ■  ^  • 

0  X      \  0 

lA  A         .  2A 


0 

•  IB 

where  0(1A)   and  0(2A)  are  pre  and  post  tests. for  the  variable 
that  is  hypothesized'  to  be.  affected  by  the  treatment  and  0  (IB) 
and  0(2B)   are  pre  and  post  tests  for  the  variable  hypothesized 
not  to  be  affected.  '       /'  -  ~ 

In  6rder»to  be  sure  this  design  will  be  credible  for  the 
situation,  the  researcher  must   (a)   specify  in  advance  which 
variables  are  expected  to  change  and  which  are  not;  (b) 
demonstrate  that  differential  change  is  not  due  to  differential 
reliability  "of  measures  or  to  ceiling/basement  effectis;  and  (c) 
use-  variables  which'  are  conceptually  so  similar  that /both  would 
be  equally  affected  by  the  same  threats  to  inter^nal  validity, 
^namely  maturation  and  testing.  ^  / 

For  example,  suppose  a  school  wanted  to  evaluate  a' computer-based 
module  on  birds  and  mammals;  and  they  also  had  available-  a  test 
on  reptiles.     Students  could  be  given  pretests  on  both  units, 
instruction  on  the  birds  and  mammals  units  only,  and  then  post 
tests  on  both  units.'       if  statistically  and  educationally 
significant  changes  occur  on  the  birds  and  mammals  unit  but  nDt 
on  the  repti],es  test,  the  birds  and  mammals  unit  is  judged  ^o  be 
effective.     Of  course,  they  would  have  to  be  satisfied  that  the 
reptiles  test  was  not  more  unreliable  that  the  other  one,  and 
that  students  were  not  already  scor ing  at  the  ceiling  of  the  \ 
reptiles  test  gt  the  time  they  were  pretested.     In  addition,  the 
investigators  would  have  to  be 'satisfied  that  the  change  in  the 
bird  and  mammals  test  was  not  du6r  to  some  learning  experience 
^i^l^her  than  the  modules,  such  as  a  television  show  about  this 
topic  during  the  treatment  period.  ' 

Cook  and  Campbell   (1979)   point  out  that  this^  basic  design  is  weak^ 
because. it. is  hard  to  be  certain  that  all  conditions  necessary 
for  its  validity  have  been  met.     However,  it  can  be  maSe  much 
stronger  by  increasing  the  number  of  measurement  "waves"  or  the 
number  of  variables.       This  also  presents  an  excellent^ design  for 
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evaluating  two  or  more  modules  at  the  same  time.. — In  this  

expanded  design,   instruction  on  one  variable  is  gi ven ,  fol lowed 
by  testing  on  all  variables.     Then  instruction  on  the  next  module- 
is  given,  followed  by  testing  on  all  variables,  and  so  on.  This 
design  may  be  shown  as: 

0  X  0  * 

lA  A  2A  * 


 [  ^  etc' 

9  0  X  0 

IB  2B        '       B  3B 

If  the  expected  pattern  of  change  occurred,  the  conclusion/ 
concerning  the  effectiveness  of  both  units  would  be  relatively 
strong.     If  the  expected  change  between  0(1A)  and  0(2A)  occurred 
but  t^he  expected  change  between  0(2B)   and  0(3B)  did  not  occur, 
the  conclusions  about  the  effectiveness  of  either  unit  would  be 
unceiftain.     Steps  in  analyzing  data  from  such  a  design  are  as 
follows : 

STEP  1 :  Determine  pre-post  differences .  Means  are 
determined  for  each  groups'   test  results  and  a  difference  / 
calculated  between  each:  / 


r)\=0-0  D=0-0  0=0-0/ 

1  ^         2A  lA  2  2B         IB;  3  3B  /2B 

,         STEP  2:  Determine  significance  of  differences.     A  t-test 
is  done  between  each  pre  and  post  test  pair  to  determine  if  post 
test!  scores  were  significantly  different  from  pre  test  scores. 
I  ■        "  '  ■  • 

'  STEP  3:  Compare  results  »..r  groups.  If  0(1)   and  0(3)  are^ 

signiif  icantly  significant  and  02  is  not,  the  instruct  ion  for  tlie" 
two  tnodules  under  consideration  can  be  said  to  be  effeyctive. 

/'         .        ■  ■ 

Berqjaist  and  Graham   (1980)  expanded  this  design  to  allow  the 
evaljaation  of  instri?ction  of  many  objectives  over  mariy  waves  Of 
measbrement.     Their  design  is  shown  in' Figure  4  below.  They' 
point  out  that  this  approach  is  useful'  to  evaluate  instruction 
with  single  students  as  well  as  groups. 

   j„ 7^:  ' 

[Figuie  4  about  here.]  / 

If  more  than  one  unit  of  instruction  is  to  be  evaluated  and  the^ 
grou.5p  is^u^f  iciently  large  (e^g*  60  students)  w  this  design  can 
be  c^ohverted  to  a  powerful  true  exp'i^iTimental  design  which  does 
not  require^a  non-CAI  control  group*     Where  instruction  can  be 
individually  administered  to^each  student   (as/with  CAI),  the 
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following  design  could  be  used: 


0 

lA 

0 

lAi 


0 

X 

0 

0 

IB 

A 

2A 

2B 

0 

X 

0 

0 

IB 

B 

-  2A 

.2B 

Here,  students  Jiust  be  randomly  assigned  (R)  to  treatment  groups 
(Xa  or  Xb)  and  fjre  and  post  tested  with  both  unit  tests  (01A  and 
01B)  .  .  ' 

Example  of  true  experimental  design  involving  • 
■  nnn-eaTrnilent  dependelir  measures.  .  One  study  using  this  design  - 

as' part  -of  its  total  evaluation  program  was  the  ETS/LAUSD  study 

of  Somputer-assisted  instruction  and  compensatory  education 
magosta,  Holland  and  Jamison,  1982).     Schools  in.  the  Los  Angeles 

Area  School  District  used  math  and  language  CAI.  available  from  - 
the  Computer  Curriculum,  Cbrpotation.     in  Grade  4  students  were 
randomly  assigned  to  receive  .tv7,o  sessions  °f  9^^  ^^^^Jy*  J^^^^  -  . 
receiv4  either:    (a)   two  sessions  of  mathematics   (MM)      (b)  one, 
session  of  reading  and  .one-  of  language  arts    (RL,  or   (c  one 
sJssion  of  mathematics  with  one  session  of  reading 
arts  on  alternate  days  ■  CMRL) .     All  students  were  pretested  in  the 

-fall  with  th»-Tnwa  Test  of  Basic  Sk-jtf Is    (ITBS)   and  a  

curriculum-specific  test   (CaT)   in  mathematics,   langv^^ge  ana 
readinq      They  were  posttested  the- next  spring  with  the 
^lufo^^ia  Test  of  Basic  -Skills   (CTBS)   and  the  CST.     Thus     the  RL 
^tidents  were  controls  for  evaluating  the.  ^"-''hnf  ?he  M^"  ' 
levels  of  mathematics  instruction   (MM  and  MRL)-,  while  the  MM 
students  were  controls  for_J:he  evaluatioti  of  two  levels  of 

/reading   (RL  and  MRL) .     A  regression  analysis  was  used  to  analyze 
the  data:     These  analysis  procedures  ace  the  feame  as  those  used 
in  Design  #4  which  follows.  ^ 

This  design  is  really  better  in  some  ways ■ than  one  having  a 
non-CAI  control  group  because  it  is  a  better  control  for 
Hawthorne  effects.     The  novelty  of  the  CAI  experience  is. the  same 
for  both  groups  so  that  the  computer  aspect  alone  cannot: be 
expec?ed  to  produce  significant  achievement  differences  betw.een  ^ 
groups.         '  .     '  ' 

Design  #4:  Regression-Discontinuity  ■  . 

"XlfHougV  th-is  is  the-  one  -design  which  actual Ly.-call.s  f.9.r..a 
no- treatment  control  group,   the  regression-discontinuity  design 
is  especially  Useful  when  compensatory  or  enrichment  programs  are 
to  be  evaluated.  This  is  so  because  of  its  requirement  that  ^ 
students  be  pretested  and  all  students  below  (or  aboveV  a  certain 
percentile  be  placed  in  a  treatment  group    AIL,  those  above   (or  .  . 
b"ow)   the  cutting  score   (i.e.  those'  who  would  not  be  eligible  • 
for  the  program  anyway)   comprise  the  control  group.     At  the^end- 
of  the  tteaiment  time,  the  postest  is  administered  to  all  those 
Sho  riceived  the  pretest,  _and  a  "dummy'-Jtreatment  variable,  is^  • 
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constructed  by  assigning  a  score  of  "1"  to  each  member  of  the 
treatment  groip  and  a  "0"  to  each  member  of  the  "non- treatment 
group."     Finally,  a  reg-ession  analysis  is  done  using  the 
following  model: 


Y     =     a       +      bT      +     b  Pre 
1  2 


Where  Y  is  the  adjusted  posttest  score,  T  and  Pre  are  the 
treatment  and  pretest  variables,   a  is  the  regression  intercept, 
b(l)    is  the  difference  between  the  adjusted  means  of  the 
treatment  groups,  and  b(2)    is  the  regression  ^°^"^^i^"^,^^^.^^J 
pretest.     If  b(l)    is  statistically  significant,   the  treatment  is 

effective  . 

The  principal  advantage  of  the  regression-discontinuity  design 
ovir  other  quasi-experimental  designs  is  that  it  is  not  biased  by 
errors  of  measurement  in  the  pretest.     That  is,   in  the  absence  of 
a  hrpatment  effect,   the  expected  posttest  adjusted  mean 
diffJrence  is  zero      That  is  not  true  in  designs  in  which  unknown 
seJe^toS  variables  operate  in  the  formation  of  treatment  and 
control  groups. 

A  primary  disadvantage  of  the  design  when  compared  to  a 
randomized  treatment-control  group  design  is  that  ^t  has  low 
power  in  being  able  to  reject  the  hypothesis  of  no  differences 
betweei  groups.     If  a  randomized  design  used  a  sample  of  120 
subilcts!  the  regression-discontinuity  design  would  require  275 
subjects  to  have  equal  power   (Reichardt,. 1979). In  addition,  if 
one  Sf  the  groups  is  relatively  small,  the  estimate  of  the 
?e5ressIon  of  p?st  test  on  pre  test  for  that  group  may  be 
unstable. 

other  precautions  should  be  kept  in  mind  when  using  this 
First,  the  process  of  assigning  students  to  groups 
"be  done  without  error.     If  the  P^^^est  is  to  be  used  as 
the  co^iate  in  the  analysis,   selection  should  be  based  on  it 
oS!v     Tf^olher  sources  of  information,  such  as  teacher  or  parent 
fSa^ments:  ^^ed  in  addition  to  or  instead  of  the  pretest, 

analvsis  ma?^  seriously  biased.     Huitema   (1980)  gives 
p^oc^Sures  for  dl^ng  with  multiple  sources  °f  . 
?he  assignment  proces^^  The  second  precaution  in  using  this 
desiqn  is  that  Son-linelRSfelationships  between  pre  and  post 
tSsts?  ihich  result  from  Ulection-motivation  factors    -y  ca-e 
or^nrinnQ  1-rpatment  effects  to  occur.     Reichardt    (1979)  suggesrea 
tilt  t^e  f  rsH^ep  in  analyzing  the  data  from  this  design  should 
bp  to  Dlot  the  raw  data  to  see  what  relationships  are  suggested. 
If  non?Unear  or  interactive  effects  are  suggested,   the  analytic 
model  giien  previously  can  be  expanded  in  an  attempt  to  account 
for  them. 

Example  of regression-discontinuity  use.     Although  no  use  of 
this  desTgn  is  available  from  the  literature,  an  example  of  a 
data  fVleTan  SPSS  procedure  file  and  the  results  from  this 
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procedure  are'given  in  Appendix        along  with  steps  for 
completing  the  procedure. 

Design  #5;  Cohort  Design 

Cohorts  are  groups  of  persons  who  follow  each  other  through  an 
institution.     For  example,   last  year's  first  graders  are  cohorts 
of  this  year's  first  graders.     The  cohort  design  compares  the 

^rformance  of  students  in  a  treatment  group  with  their  cohorts 
that  did  not  receive  the  treatment.     This  design  is  especially 
useful   in  evaluating  the  effectiveness  of  newly-installed, 
year-long  computer-based  programs  where  it  is  not  feasible  to 
withhold  th^r'  program  from  some  students   in  order  to  have  a 
control  grou').     The  design  makes  the  assumption  that  student 
cohorts  are  comparable  in  most  respects,   and  that  differences 
between  them  c-^  a  dependent  variable  can  be  attributed  to  a 
treatment  admin  stered  to  one  of  the  groups. 

In  its  simplest  form,   the  design  is  as  follows: 


0(1)   represents,   for  example,   a  final  achievement  measure  of 
students  in  a  certain  grade  in  a  given  year,  and  0(2)  represents 
the  same  final  achievement  measure  of  students  in  the  same  grade 
the  year  after  that  after  having  received  some  instructional  . 
treatment.     If  a  t-test  of  the  differences  between  means  of 
independent  samples  yields  a  statistically  significant  result, 
and  that  difference  is  large  enough  to  be  considered 
educationally  significant,   the  treatment  is  said  to  be 
successful. 

A  disadvantage  to  this  design  is  that  its  use  depends  on  the 
yearly  availability  of  appropriate  equivalent  measures.  Also, 
Cook  and  Cambell   (1979)    indicated  that  the  design  in  this  form  is 
weak  because  differences  between  the  two  groups   (other  than  the 
treatment)   could  cause  a  difference  in  achievement   (selection) . 
Events  other  than  the  treatment  could  depress  achievement  for  the 
control  cohort  or  enhance  it  for  the  treatment  cohort   (history) . 
Variations  in  testing  conditions  or  procedures  could  also  be 
responsible  for  differences  in  per f ormance .     The  design  can  be 
strengthened  by  adding  a  pretest  if  it  is  available.  This 
augmented  design  is  shown  as  follows: 


0 


1 


2 


0 


0 


1 


2 


0 


X 


0 


3 


4 


The  pretest  could  be  an  end-of-year  test  or  one  that  is  routinely 
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administered  in  the  fall.     The  data  would  be  analyzed  using 
regression  analysis,   the  same  method  used  in  the 
regression-discontinuity  design.     Here,  however,  each  treatment 
student  would  be  given  the  "dummy"  code  "l'|  and  each  student  in 
the  cohort  from  the  year  before  a  code  of  "0." 

Example  of  cohoyt  design  use.     Garretson,  Vertuno,  Roblyer 
and  King   (1983)   used  this  design  in  a  study  of  a  computer-based 
reading  and  writing  program,   the  "Writing  to  Read"  program  from 
IBM,   inc.     Approximately  fifty  students  from  each  gf^^e  served  as - 
subjects,  and  it  .vas  not  considered  feasible  to  withhold  the 
treatment  from  any  of  them.     A  readiness  test  was  available  for 
both  the  treatment  and  control  kindergarten  cohort,   so  it  was 
used  as  a. pretest.     No  pretest  measure  was  available  for  the 
first  grade  students.     The  dependent  variable  was  the  reading 
score   (prereading  for  kindergarten)   from  the  California  Test  of 
Basic  Skills   (CTBS)   administered  at  the  end  of  both  kindergarten 
and  first  grade.     The  analysis  for  the  kindergarten  students  was 
performed  as  follows: 

STEP  1:  Calculate  means  and  standard  deviations.  The 
means  and  standard  deviations  of  both  groups  on  both  measures 
were  determined: 

Treatment    (1982-83)  Control  (1981-82) 

Mean  SD  Mean  SD 

Reading       129.00  13.73  124.59  14.13 

Pretest  6.29  1.47  6.11  1.57 

STEP  2-   Perform  regression  analysis.     This  analysis 
actually  involves  several  steps,  but  they  will  not  be  detailed 
here  since  the  SPSS  program  described  in  Appendix  D  accomplishes 
them.     The  results  were  as  follows: 

« 

Variable  b  F  Significance 

Treatment   (bl)         3.79  2.12  >.05 

Pretest  (b2)  4.10  22.54  <.05 
intercept   (a)         99.52       314.96  <.05 

Data  for  the  first  grade  were  analyzed  using  a  t-test  for 
comparing  two  groups.     The  results  were: 

Treatment   (1982-83)  Control  (1981-82) 

Mean  SD  Mean  SD 


Reading  63.79 


14.36  61.56  18.80 


t-ratio  =  .65 
(p>.05) 


The  results  for  neither  grade  showed  a  significant  treatment 
effect      These  findings  are  not  in  agreement  with  those  in  the 
value-added  analysis  in  which  the  treatment  effect  for  the 
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Nonsense  Words  Tests  were  significant.     The  different  results 
could  be  due  to  a  number  of  reasons.     (See  discussion  in 
Garretson  et  al.) 

However,  despite  its  failure  to  demonstrate  a  significant 
treatment  effect,   the  cohort  design  is  considered  to  be  superior 
to  a  design  in  which  the  control  group  is  not  equivalent  to  the 
experimental  group   (e.g.  the  groups  are  obtained  from  different 
schools) .     The  populations  from  which  the  cohorts  were  drawn  were 
probably  more  similar  than  those  .using  students  from  different 
schools.     Also,   the  school  environment   (principal,   teachers, ^ 
facilities,   etc.)   for  the  cohorts  would  probably  be  more  similar 
than  would  the  environments  in  different  schools. 
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DISCUSSION   AND  SUM 

Although  most  research  studies  reported  in  icational 
technology  literature  use  a  non- treatment  con  group  design, 

this  approach  is  often  not  feasible  in  non-lac   -   ^-lory  situations. 
The  microcomputer  movement  in  schools  has  create,  a  wealth  of  new 
research  opportunities,  many  of  which  will  require  designs  more 
suited  to  actual  classroom  implementation,  such  designs  are 

described  here: 

1.  Sequential  analysis 

2.  Value-added  analysis 

3.  Non-equivalent  dependent  variables 

4.  Regression-discontinuty 

5.  Cohort  design 

Depending  upon  the  needs  of  the  researcher  and  the 
characteristics  of  the  research  situation,  each  of  these  can 
serve  as  a  practical  alternative  to  a  design  requiring  a 
non-treatment  control  group.     To  aid  school  researchers  in 
employing  these  designs,  statistical  analysis  methods  and  tools 
are  also  provided  for  each  one.     Several  caveats  are,  however,  in 
order . 

Choosing  the  Appropriate  Design 

Each  of  the  designs  described  here  can  be  appropriate  for 
studying  various  aspects  of  computer-aided  instruction.     But  like 
'all  research  designs,  each  has  assumptions  which  must  be  met  and 
requirements  which  must  be  considered  if  the  research  is  to  be 
perceived  as  valid.     The  flowchart  shown  in  Figure  5  summarizes  a 
decision  path  which  one  might  take  to  choose  the  most  appropriate 
design  for  the  situation. 

[Figure  5  about  here.] 


However,  even  after  selecting  the  most  useful  of  these  designs, 
the  researcher  must  recognize  that,   like  all  designs,  each  has 
its  strengths  and  weaknesses.  Using  two  of  these  designs  together 
can  work  to  make  the  total  study  stronger.     For  example,  in 
Garretson  et  al    (1983),   the  cohort  design  and  the  value-added 
analysis  were  used.     Ideally,   the  results  of  these  two  designs 
would  be  the  same  and  thus  support  the  conclusions  of  the 
research. 

Specifying  Power 

The  sequential  analysis  method  is  the  only  one  of  the  five  which 
forces  the  researcher  to  set  alpha.  Beta  and  effect  size  ahead  of 
time.     However,  this  practice  is  desirable  for  all  designs 
(including  true  experiments)    in  order  to  determine  that  the  study 
has  sufficient  power  to  reject  the  null  hypothesis  when  it  is 
false  or  to  allow  acceptance  when  it  is  true   (Cohen,  1969). 
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Required  Research  Expertise 

Several  aids  are  provided  here  to  assist  those  with  limited 
statistical  experience  in  selecting  and  implementing  the  most 
appropriate  of  these  designs.     It  should  be  apparent,  however / 
that  using  these  designs  require  some  expertise  in  both  research 
and  statistics.     The  minimum  training  would  probably  include 
introductory  courses  in  research  methods,  descriptive  statistics 
and  inferential  statistics.     And,  of  course,  some  experience  in 
implementing  research  studies  is  helpful.     To  those  with  such 
expertise  available  to  them,   the  designs  described  here  can  and 
should  be  useful   in  implementing  research  to  direct  the  course  of 
their  educational  computing  activities. 
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Obj.      Pretest  Interim  Tests  Posttest 
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?igur«         Multiple  Waves,  Multiple  Variables  Design 
( Berquist  and  Graham,  1980) 


277 

o  294 

ERIC  _  ^_  _1 


Nc)  ikisitjn  available 


scijiK^nl  idl 
analysis 


vahMj-.itfckxJ 
ai^  lysis 


i»>n-cNl\iivalGnl 
iui4j|iei>tlent  variables 
riesiqn 


o  treaUncnt  ami  i»>n-^   /  ex|jer iiirjntal 


(lcsi<jn 


re<jression- 
disaiiiLinuity 
<lesi«jn 


l>o 
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<k?sign 
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r 

Appendix  A 

Applesoft  Basic  Program  for  Sequential  Analysis 

The  program  requires  the  user  to  enter  proportions  for  the  AQL 
and  RQL,  as  well  as  values  for  alpha  and  Beta.     HI,  H2,  and  S  are 
used  to- construct  the  upper   (UL)   and  lower  lines   (LL)   of  the 
acceptance-rejection  graph: 


LL  =  -HI  +  Sn 
UL  =     H2  +  Sn 


where  n  is  the  nth  subject.     Dl  and  D2   in  the  output  are  values 
tor  the  lower  and  upper  lines  where  n=10.     They  are  given  to 
facilitate  plotting  of  the  lines. 

Following  the  listing  of  the  truncation  number  and  inout 
specifications,   the  user  is  asked  whether  or  not  a  table  of 
values  should  be  printed.     If  the  answer   is  "yes,"  the 
acceptance/rejection  table  is  printed.     it  is  simply  a  tabular 
representation  of  the  graph. 

Coordinates  for  the  Operating  Characteristics   (OC)   Curve  and  the 
Average  Sample  Number   (ASN)  Curve  are  printed  if  the  user  desires 
them.     In  both  curves,  p  (the  true  proportion  of  failures)  is 
plotted  on  the  horizontal  axis.   L(p),   the  probablity  of  rejecting 
the  instruction,  and  E(N),   the  average  sample  numbers,  are 
plotted  on  the  vertical  axis. 

entry°^^°"^"^  sets  of  numbers  can  be  used  to  check  your  program 


I  nput 

AQL  RQL  alpha 


Beta 


(1)  .90  .70 

(2)  .90  .70 

(3)  .85  .75 


HI  H2 


01  .10 
05  .15 
05  .15 


Output 


(1)      -1.698  3.333  .186 


{2r     -1.  367  2.099 


Truncate 


112 


186  57 


(3)     -2.902  4.455  .197  245 
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IS  INPLT  "£NTHR . PROPORTION  FOR  ^ 
IGH  QL'PLITY  ":P1 

„2^3  ^:5INT_  

25  Pi  ■  1  -  PI 

30     INPUT  "ENTER  PROPORTION  FOR  ■ 

OW  QUPLITY  ":P2 
3S  PRINT 
. 40  P2  -  1  -  P2 

45  INPUT  "ENTER  PLPHft 

46  PRINT 

50  INPUT  "ENTER  BETft  ":B1 

51  PRINT 

55  INPUT  "ARE  ALL  ENTRIES  CORREC ■ 

T*?  Y*^N  "  •  NS 

56  PRINT 

60     IF  NS  -  GOTO  15 

70  Gl  -  C  LOG  (P2  /  PD)  ♦  .43429 
448 

73  32  -  (  LOG  (C  -  P2)  /  (1  -  PI 
)  )  )   ♦  .  4342944S   

'80'  fl  -  <  LOG  ((1  -  Bl)  /  PD  )  ♦  . 
43429448 

85  B  »   (  LOG   (Bl  /   (1  -  fll) ) )   ♦  • 

43429448 
•90  HI  ■  B  /    (G:  -  G2) 

95  PRINT  "Hl-INTERCEPT  ftT  ZERO  F 

OR  THE  LOWSR  LINE*  "iHl 

96  PRINT 

100  H2  -  ft  /   <G1  -  G2) 
-10S     P.RINT-??^H2»INTERCEPT  AT  -ZERO 
FOR  THE  UPPER  LINE-  ":H2 

106     PRINT  _   

110  S3  -  31  -  G2 

lis  G4  -   (  LOS  ((1  -  PI)   /    (1  -  P 

2) ) )   ♦  . 43429448 
120  3  -  G4  /   (Gl  -  G2) 

122  PRINT  "S  ■  "?S 

123  PRINT 

125  Dl  »  HI  •»■  (S  ♦  10) 

130  PRINT  "Dl-LOWER  LINE  VftLUE  ft 
T  N  EQUftLS  10  -  "?D1 

131  PRINT 

135  D2  -  H2  •»•  (S  ♦  10) 

140  PRINT  "D2-UPPER  LINE  VALUE  ft 
T  N  EDCftLS  10  -  "?D2 

141  PRINT 

15tZr  N  -   (3  ♦   (ft  ♦  B)  >   /    (31  ♦  32) 

155.    PRINT  "TRUNCfiTE  ftT  N«  "rN 
156  PRINT 

150  PRINT  "WftLD, ""Pl-"1  -  PI","" 
P2«"l  -  P2",  ""ftLPHft-"ftl",  •*"B 
STft-"Bl 

161  ORINT 

166  PRINT 

170  INPUT  ••DO  YOU  WftNT  TO  PRINT 
ft  TftBLE  CF  VfiLUES?  Y  ^  Nj  " 
:N$ 

171  PRINT 

175  N*  «  "N"  GOTO  253 

180     PRINT  "N". "QCCEPT". "REJECT" 


181 

.135 
190 

-195- 

200 

£10 

220 

22S 
230 
231 
235 

236 
240 
245 
246 
250 


PRIN^ 
N  =  0 
I  «  10 

-M— «— !VJ— 


260 
270 
275 
280 

285 
290 
295 
300 
305 


310 
314 


R0  =5   (B  /  G3)   •»■   (N  ♦   (G4  /  G3 
)  ) 

Rl  -   (ft  /  53)   •»■   (N  ♦   (G4  /  G3 
)  ) 

PRINT  N  TftB(   16) RO  TftB (  31) R 

IF  N  a  I  GOTa  235 

GOTO  195 

PRINT 

INPUT  "DO  YOU  WfiNT  ftNOTHER  1 
0  VftLUES?  Y  ^  N:     " ;N* 
PRINT 

TC  |V»»  a   »\»   GOTO  250 
I  ■  I  •»■  10 
GOTO  195 

I\PU^  .1         YQ^j  gpMT  Q  -^PBLE 
OF-  VftLUES  -  OF  THE  -COCRDINftTES 
^0  PLOT  ftN  CC  CURVE?  Y'^N:  " 
:NS 
PRINT 

::=•        «  »N"  SOTO  340 
PRINT 

PRINT  "CCORDINftTES  ^OR  OC  CU 

RVE" 

PRINT 

PRINT  "VflLUES  OF_P",."LJP)."._. 

"  PRINT     '  ' 

PRINT  0, 1 
PRINT 

"Pi, 


ftl 


316 
320 
321 
322 
325 
330 
335 
340 


PRI.V 
PRINT 

K  ■     INT   (  (S  •»■  ,00005)   ♦  1000 

>Z)    /  10000 
Kl  -  H2  /    <  (  ftBS   (HI)       H2)  ) 
PRINT  S,K1 
PRINT 

PRINT  P2,  Bl 
PRINT 
PRINT- 1,0 
PRINT 

INPUT  "DO  YCU  WftNT  ft  TftBLE  0 
F  VftLUES  PGR  THE  COORDlNftTES 
■^0  PLOT  ftSN  CURVE?  Y^  Ni    '  ? 

350     IF  \t  ■  "N"  GOTO  4Aii 
360  PRINT 

370     PRIN"  "CCORDINftTES  FOR  PSN  C 

URVE- 
375  PRIN-^ 

"380     PRINfT  "VftLUSS  OF  P",  "E"(N)  " 

385  PRINT 

386  K2  -    PBS  (HI)    /  S 
390     PRINT  0,K2 

395  PRINT 

397  K4  «  <<1  -  ftl)   ♦    ftPS   (HI)  - 

ftl  ♦  H2)    /    (S  -  PI) 
AC®     PRINT  P1,X4 
A05  PRINT 


BEST  COPY  AVAIUBLE 


406  K5  -   <  ftBS   (HI)   ♦  H2)    /   (S  * 

(1  -  S)  ) 
410     PRINT  S.  K5 

415  PRINT 

416  K6  -   <<(!  -  Bl)   ♦  H2)   -   (Bl  ♦ 

ftBS   (HI) ) )    /    (P2  -  S) 
420  ...PRINT  K6 

425  '•'RINT 

426  K7  -  H2  /   (1  -  S) 
430     PRINT  1,K7 

435  PRINT 
530  END 
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Enter  proportion  for  high  quality  .90 
"E"n""reTr— pTT-o-p-oTtri-o-n— f-o-r— l-o  w-  q  u  a-l-i-t-y  ^-7-0  


Enter  ALPHA  .01 
Enter  BETA     . 10 

Are  All   entries   correct?   Y.   N  Y 

Hl=Intercept   at   Zero   for   the   lower   line=  -1.69826608 
H2=Intercept   at   Zero   for   the  Upper  Line=  3.3333733 
S   =  .186168942 

Dl=Lower  Line  Value   at  N  Equals    10  =  .163433334 
D2  =  Upper  Line -Value   at  N  Equals-  10  = 5-.  19508772 
Truncate   at  N=  112.090667 
Wald,    P1=.9,P2=. 7,ALPHA=.01,BETA=. 1 

Do  you  want   to  print   a   table  of  Values?   YN:  N 
„.Do  you  want  a  .Table  of  Values  of   the   Coordinates   to  plot  an 
do   curve?   Y  N:  Y 

Coordinates   for  oo   Curve  —    


Values   of  P  L(P) 

0  1' 
.1  .99 

. 186188942  .  662482552 

.3  .1 

1  0 

Do   you  want   a  table  of  Values   for   the   Coordinates   to  Plot  ASN 

Curve  Y  N:   Y  -    ^ -   

Coordinates   for  ASN  Curve 

Values   of  P  E (N)  ■ 

0  '  9.12217724 
.1  19.1246365 
.186168942      ,  37.3635557. 
.3                     ,  24.8632439 

1  4.09590328 
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Appendix  B 
Computations  for  Value-added  Analysis 


1.     Computation  of  the  value  added  by  the  treatment  (V) 

V  =  y     -     y     -   •  b  (d ) 
2  1 

where  y     and  y     are  pre  and  post  test  means 
1  2 

b  is  the  slope  coef f icient  for  the  regression  of  pretest  on 
age ,  and 

d  is  the  mean  time  span  between  the  pre  and  post  tests. 


2.  Computation  of  pseudo- values    (V  ) 

*i 

A.  Compute  the  regression  coefficient   (b)   using  the  whole 
data  set..  

B.  Compute  a  regression  coefficient   (b  )  with  observation  i 

-  -   ■    -  -  i   -  -  -  -  -   

removed  from  the  data.     N  coefficients  will  be  computed. 

C.  Cbmpute  a  pseudo-value   (V      r  for  each  individualT-- 

V      =     y     (t)-y(t)-b  {.a— tt--H 
*i  i       2  i     1  *i       i  2 

where  y   (t  )   and  y   (t  )   are  post  test  and  pre  test  scores 
i     2  i  1 

for   individual  i 

a     (t  )     and  a     (t  )   are  the  ages  of  individual   i at 
i       2  i  1 

post  test  and  pre  test  times,  and 

*i  is  computed  as  shown  below: 

b       =     Nb  -    (N  -  1)  bi 

...    .  -.*i  ...   

D.  Compute  the  mean  and  standard  error  of  the  's. 

Calculate  a  t-ratio  by  dividing  the  mean  by  the  standard  error. 

The  data  file  on  the  next  page  contains  scores  for  age  (in 
months),  and  pre  test  and  post  test  scores  for  10  subjects.  The 
first  SPSS  procedure  file  computes  the  regression  coefficient  and 
the  sums,   sums  of  squares,   and  sum  of  cross  product s  needed  for 
the  next  program. 
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Appendix  B  (cond.) 
The  output  of  the  procedure  is  as  follows: 


Regression  coefficient   (b)  1.134 

Sum  of  age  scores   (SX)  690 

Sum  of  pre  test  scores   (SY)  224 
Sum  of  cross  products  of  age 

and  pretest   (SXY)  15778 

Sum  of  squares  of  age   (SXQ)  47894 


The  output  of  the  second  SPSS  procedure  gives  the  mean  (2.028) 
and  standard  error"T2 . 515 )   of  the  pseudo--values    (V       )  . 

*i 

The  t^ratio  is  2.028/2.515  =  .806.  Thus,  for  these  19  cases,  the 
value  added  by  the  treatment  is  not  statistically  significant. 
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DATA  FILE 


SPSS  PROCEDURE  H 


':'3  25  29 

'2  38  39 

•I  30  35 

■'9  30  44 

^2  7  12 

■rV  10  16 

-jO  22"  27 

68  22  36 

54  28  30 


5.       "  VARIABLE  LIST 

5.005     AGE  PRE  POST 
10.  INPUT  FORMAT 

10.005  FIXECi<F2.0r2F3.0) 

15.  COMPUTE 
15.005  SXY=AGEltPRE 

16.  COMPUTE -•- ' '  " 
16.005  SXQ=AGE**2  • 
20.  REGRESSION 

-~20T00S — VAR1ABLES  =  AGE  ■PRE/REGRESSION=PRE~  UTTH  r^GE 
30.  CONDESCRIPTK'E 
30.005  AGE>PRErP0STt5XY.SXQ 


SPSS  PROCEDURE  t2 


5. 

VARIABLE  LIST 

5.005 

AGE  PRE  POST 

10. 

INPUT  FORMAT 

10.005 

FTXED(F2.0r2F3.0) 

60. 

COMPUTE 

60.005 

SXy-15778            .  .   

COMPUTE 

A5.005 

-oxn=-47994 

?0. 

COMPUTE 

70.005 

SX=690 

COMPUTE 

7'=;.005 

SY=224 

. 

COMPUTE 

90.005 

£1=1 .  134 

35. 

COMPUTE 

< iSX-AGE)«<SY-PRE) ' 

35.005 

NUM=(9*(SXY-lAGE*PRE) ) >- 

90. 

COMPUTE 

90.005 

DEN0M>=C9«(SXn-<  AGE«*2)  )  ) 

-< (SX-AGE>«*2) 

92. 

COMPUTE 

92.005 

BI=NUM/DENOM 

94. 

COMPUTE 

BSI=(  i(RcB)'-(9*BI  I 

94,665 

S/C/RETURN 


c 


9o.  COMPUTE 

96.005  V=P0ST-PRE-(BSI*4) 

98.  CONDESCRIPTIVE 
99.005  V 

99.  STATISTICS 
99.005  lr2 
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«  Appendix  c 

Analysis  and  Results  of  the  Regression-Discontinuity  Design 

The  data  file  is  shown  in  the  upper  left-hand  corner  of  the  next 
page .     There  are  eight  treatment  students  below  the  pretest 
cutting  score  of  40,   and  eight  control  students  above  it. 
Columns  1  and  2  contain  a  student  ID  number.  Column  3  is  the 
group  membership  variable   ( trea tmen t=l ,  control=2),   the  next  two 
columns  cbntain  the  pre  test  scores/  and  the  post  test  is  in  the 
last  two  columns. 

The  SPSS  procedure  file  is  given  to  the  right  of  the  data  file. 
Lines  5  .0  - and- 1-0  .  0  spec  i  fy  -  the  names  of-  the  var  iables  "and the 
input  format,   respectively.     Line  200   is  the  regress  ion 
procedure  ... .  .1 1  specif  ies  "  the  -  dependent  variable  is  the  post  testy 
and  the  independent  variable   is  the  treatment  variable  and  the 
pretest.     Line  25.0  causes  means ,   standard  deviations ,  and 
correlations  to  be  printed. 

The  output  of  the  procedure  consists  of  means,  standard 
deviations,  and  correlations  of  the  three  variables  as  labeled. 
The  last  three  lines  of  output  show  the  intecept  and  regression 
coef f  icients  : 

- = 35.00  + 9.72  +   .37  Pre 

The  columns  labeled  F  and  Sig.   show  that  all  effects  are 
statistically  significant.     The  treatment  regression  coefficient 
(bl)    is  the  adjusted  difference  between  treatments.     The  results 
are  graphically  illustrated  in  the  figure  that  follows  the 
output.     The  difference  in  intecepts  of  the  cutting  score  is  the 
estimate  of  the  treatment  effect. 
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DATA  FILE 

I 

1 

11 

39 

2 

1 

13 

44 

3 

1 

19 

42 

4 

1 

25 

46 

5 

1 

24 

50 

6 

1 

30 

42 

7 

I 

2o 

54 

3 

1 

IS 

48 

9 

0 

43 

56 

10 

0 

42 

60 

1 1 

0 

50 

53 

12 

0 

51 

d1 

13 

0 

55 

62 

14 

0' 

54 

15 

0 

o2 

a3 

1-T 

0 

o3 

67 

SPSS  PROCEDURE 


5.  ^JARIA&LE  LIST 

5.005   IDf T'PREf POST 
10.  INPUT  FORhAT 

10.005  FIXEr«r.2F2.Cf  2F3.0) 
20.  REGRESSION 

20.005  <JARlABLES=T'PRE»POST/ 

20.006  REGRESSICN=POST  WITH  T 
25.  STATISTICS 

2S..005  .  1.1  2  


PRE 


OUTPUT 


v«ARlA&LE 


MEAN 


STANDARD  DEV 


CASES 


PRE 
POST 


.5000 
36.S125 
53.6250 


.5164 
17.7053 
4.3340 


1a 
16 
16 


CORPELATIOrJ  CuEFFICIENTS. 

VALUE  OF  9«5. 00000   IS  PRINTED 
IF  A  COEFFICIENT  CANNOT  BE  COMPUTED. 


PRE 
POST 


-.91507 
r ,23330 


T 

DEP.   VAR...  POST 
MEAN  RESPONSE 
FINAL  STEP. 


. .46642 
PRE 


53.62500 


STD.  DEV. 


4..  3339' 


...•^.ULI.IPLE__R  

R  30UARE 

STD  DEU 

ADJ  R  SQUARE 

VARIABLE 

T 


,.6o03  ANOVA 


.4360  REGRESSION 
3.4962  RESIDUAL 
.3492   COEFF  OF  VARIABILITY 


DF      SUM   S0MARE3_  _mE-VJ_  =0  . 

2 .  1  22  .  l3-»7  "       z  1 .  423 

13.  158.903         12.223  SIG. 

6.5PCT 


PRE 

CONSTANT 


9 .  727 
.374 
35.003 


5.E 
4 


34 
.  12CJ 

6.  rsi 


5.036 
9.741 
26.383 


SIG. 

.043 
.011 
.000 


BET; 

I  .15393 
I  .52£>92 


ELASTICITY 


•  ■'•J0i)9 


288 

305 


i 


Pre  test 


ERIC 


306 


V 


TITLE:     Foundations  of  Naturalistic  Inquiry:  Developing 
a  Theory  Base  For  Understanding  Individual 
Interpretations  of  Reality 

AUTHOR:    J.  Randall  Koetting 


ERIC 


290  307 


U.S.  DEPARTMENT  OF  EDUCATION 
NATIONAL  INSTITUTE  OF  EDUCATION 
FDUCATIONAL  RESOURCES  INFORMATION 

CENTER  (ERIC) 
L)  This  document  hai  been  fcproducod  as 
received  from  the  person  or  orflanizatlon 
originating  it. 
□  Elinor  changes  have  been  made  to  improve 
revvoduction  quality. 

•  Points  b<  VM*^  or  opinibns  stated  in  this  docu- 
ment do  not  necessarily  represent  oHicial  NIE 
position  or  policy. 


Research  and  Theory  Division  Symposium: 

Naturalistic  Methodologies  for 
Deriving  Individual  Meanings  from  Visuals 


FOUNDATIONS  OF  NATURALISTIC  INQUIRY: 
DEVELOPING  A  THEORY  BASE  FOR  UNDERSTANDING 
INDIVIDUAL  INTERPRETATIONS  OF  REALITY 


J.  Randall  Koetting 
Assistant  Professor 
Oklahoma  State  University 
Stillwater,  Oklahoma 


Association  for  Educational  Communications 

and  Technology 
National  Convention 

Dallas,  Texas 
January  20-24,  1984 


^•PERMISSION  TO  REPRODUCE  THIS 
MATERIAL  HAS  BEEN  GRANTED  BY 

Michael  Simonson 


291 

308 


TO  THE  EDUCATIONAL  RESOURCES 
INFORMATION  CENTER  (ERIC)." 


Foundations  of  Naturalistic  Inquiry- 
Developing  A  Theory  Base  for  Understanding 
Individual  Interpretations  of  Reality 

This  symposium  is  concerned  with  naturalistic  methodologies  in  research  on 
visuals.    The  purpose  of  my  paper  is  to  focus  on  the  foundations  of  naturalistic 
inquiry.    Foundation,  in  this  sense,  is  concerned  with  explicating  the  theory 
base  of  naturalistic  inquiry.  / 

I  will  focus  on  the  foundations  of  natural isW-tTi^riry  by  looking  at 
3  paradigms  for  research.    My  discussion  will  center  on  questions  of  epistemology 
(What  do  you  mean?    How  do  you  know?).    I  will  indicate  the  place  of  naturalistic 
inquiry  within  the  above  discussion  and  identify  differences  between  paradigms. 
Finally  I  will  suggest  elements  of  a  research  methodology  that  exemplifies  an  ' 
interpretive  and  critical  methodology. 

When  we  do  research,  we  try  to  gain  a  clear  or  clearer  perception  of  reality. 
This  clearer  perception  of  reality  can  be  of  benefit  to  us  depending  on  our  in- 
terests, what  we  are  searching  for  (truth?  knowledge?  Information?  Understanding? 
Explanation?  Emancipation?).    This  in  turn  has  a  bearing  on  what  we  define  as  the 
research  "problem/situation"  under  investigation. 

There  are  certain  research  paradigms  that  have  emerged  over  the  last  few 
years.    Bredo  and  Feinberg  (1982)  identify  differing  paradigms  according  to  the 
research  methodologies  utilized.    These  methodologies  have  inherent  interests  in 
the  kinds  of  research  findings  generated. i  find  their  identification  of  three 
research  paradigms  useful  for  determining  what  I  consider  to  be  the  foundations 
of  naturalistic  inquiry. 

Bredo  and  Feinberg  identify  the  positivistic  approach,  the  interpretive 

approach,  and  the  critical  approach  to  social  and  educational  research.  Returning 

to  my  earlier  comment  regarding  research  and  gaining  a  clear/clearer  perception  of 

reality,  our  interests  in  doing  research  are  varied.    For  example,  we  may  try  to 

better  control  reality,  in  order  to  make  predictions,  develoD  law-like  theories/ 
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explanations,  establish  causal  relationships,  etc.    This  would  correspond  to  the 
positivistic  approach  to  research. 

We  may  want  to  better  understand  reality,  and  hence  ourselves  and  others 
within  a  given  context,  meanings  attached  to  social  customs,  etc.  This  would 
correspond  to  the  interpretive  approach. 

We  may  want  to  better  understand  reality,  and  hence  ourselves  and  others 
within  a  given  context  in  order  to  act  within  that  context,  to  effect  change. 
This  corresponds  to  the  critical  approach  to  social  and  educational  research. 

Fundamental  differences  separate  the  positivistic  approach  from  the  inter- 
pretive and  critical  approaches.    The  differences  are  of  a  philosophical  nature, 
concerned  with  the  nature  of  reality  (ontology),  the  relationship  of  subject- 
object,  the  purpose  of  inquiry  (generalization),  the  nature  of  knowledge  the  means 
of  data  collection/analysis  (epistemology) ,  the  relationship  of  individuals  to 
society,  and  the  role  of  values  in  inquiry  (axiology). 

Using  Guba  (1982,  1983),  and  Bredo  and  Feinberg  (1982),  I  would  like  to  high- 
light some  of  the  major  differences  between  the  positivistic  approach,  and  the 
interpretive  and  critical  approaches.    The  differences  I  want  to  discuss  are 
concerned  with  ontology,  subject-object  dualism,  generalization,  causality,  and 
axiology. 

There  is  a  danger  here  in  oversimplifying  the  positivistic,  interpretive  and 
critical  approaches.    Guba  (1983)  points  out  that  there  is  no  "real  or  ultimate  or 
absolute  statement  that  could  be  made"  for  each  of  these  approaches.    As  he  states, 
"All  statements  are  constructions;  the  issue  here  is  whether  my  construction  is 
fair"  (p.  6). 
The  Positivistic  Paradigm 

ONTOLOGY  (nature  of  reality).    For  the  positivist  researcher,  reality  is  a 
"given".    It  exists  "out  there",  and  can  be  divided  into  dependent  and  independent 
variables.    These  can  be  studied  independently  of  each  other.    "Inquiry  can  converge 
onto  that  reality  until,  finally,  it  q303e  predicted  and  controlled"  (Guba,  1982, 
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1983).    In  other  words,  the  world  is  seen  as  given,  single,  tangible,  fragmentable, 
convergent. 

SUBJECT-OBJECT  RELATIONSHIP.    The  researcher  maintains  a  distance  between  self 
and  the  object  under  investigation,  "neither  disturbing  it  or  being  disturbed  by 
it"  (Guba,  1982,  1983). 

PURPOSE  OF  INQUIRY  (Generalization).    The  purpose  of  inquiry  is  to  develop  a 
"nomothetic  body  of  knowledge."    This  knowledge  is  best  stated  in  law-like 
(nomological )  generalizations  which  are  seen  as  truth  statements  outside  of  time 
and  specific  context  (hence  they  are  true  for  all  circumstances  and  times-cf.  Guba, 
1983,  p.  7). 

EXPLANATION-CAUSALITY.    As  Guba  (1983)  states:    "Every  action  can  be  explained 
as  the  result  (effect)  of  a  cause  that  precedes  the  effect  temporally  (or  is 
simultaneous  with  it"  (p.  7). 

AXIOLOGY  (The  role  of  values  in  inquiry).    Inquiry  is  value  neutral.  This 
is  ensured  by  the  nature  of  the  methodology  used  -  "the  facts  speak  for  themselves" 
(Guba,  1983,  p.  7). 
The  Interpretive  Paradigm 

I  will  use  the  same  areas  I  briefly  indicated  in  the  previous  section  in 
characterizing  basic  viewpoints  of  the  positivistic  paradigm  to  identify  the  inter- 
pretive paradigm.    The  viewpoints  I  describe  below  also  hold  for  the  critical 
paradigm.    The  viewpoints  discussed  stand  in  oppostion  to  each  other.  Naturalistic 
inquiry  falls  within  the  interpretive  and  critical  paradigms,  so  I  am  getting 
closer  to  identifying  the  theoretical  underpinnings  of  naturalistic  inquiry. 

ONTOLOGY  -  The  world  is  made  up  of  tangible  and  "intangible",  mul ti -faceted 

(2) 

realities.    These  are  best  studied  as  a  unified  whole. ^  '  Investigation  into  each 
of  the  multiple  realities  will  bring  about  divergence  (suggesting  further  questioning) 
Understanding  can  be  achieved,  but  "prediction  and  control"  are  not  our  intent 
(cf.  Guba,  1983,  p.  9). 
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SUBJECT-OBJECT  RELATIONSHIP.    The  inquirer  and  the  object  of  study  interact 
to  influence  one  another  (especially  when  the  object  is  another  human's  perceptions  - 
cf.  Guba,  1982,  1983). 

PURPOSE  OF  INQUIRY  (Generalization).    The  aim  of  inquiry  is  to  develop  an 
"ideographic"  body  of  knowledge.    We  can  then  develop  a  series  of  working  hypotheses 
that  exemplify  the  "individual  case"  (cf.  Guba,  1983,  p.  9). 

EXPLANATION  (Causality).    Guba  (1983)  states  that 

An  action  ma^  be  explainable  in  terms  of  multiple  interacting  factors, 
events,  and  processes  that  shape  it  and  are  part  of  it;  this  interaction 
manifests  itself  as  mutual  and  simultaneous  shaping;  inquirers  can,  at 
best,  establish  plausible  inferences  about  the  pattern  of  such  shaping 
in  a  qiven  case  (p.  9).  "  . 

AXIOLOGY  (jhe  role  of  values  in  inquiry).    Inquiry  is  value-laden.    Inquiry  is 
influenced  by  the  researcher's  values  as  shown  in  the  "choice  of  the  problem  and 
in  the  framing,  bounding,  and  focussing  of  that  problem."    Inquiry  is  influenced  by 
the  research  paradigm  the  researcher  choses.    The  paradigm  "guides  the  investigation 
into  the  paradigm."    Inquiry  is  influenced  by  specific  methodologies  within  the 
research  paradigm.    The  methodologies  "guide  the  investigation  into  the  problem." 
Finally,  "inquiry  is  influenced  by  the  values  that  inhere  in  the  context:  social 
and  cultural  norms"  (cf.  Ruba,  1983,  p.  10). 

The  following  schematic  representation  (fiq.  1)  is  offered  to  help  clarify 
the  previous  discussion.    It  is  based  on  Guba  (1982,  1983),  Culbertson  (1981),  Bredo 
and  Feinberg  (1982),  Habermas  (1971),  and  my  own  efforts  at  putting  this  information 
into  some  systematic  order. 


Figure  1 


It  is  important  to  acknowledge  the  differences  between  the  paradigms.  They 
are  bas3d  on  differing  world-views.    All  three  paradigms  are  needed  to  better 
understand/to  gain  a  clearer  perception  of  our  world  and  our  place  within  that 
world.    Although  I  do  not  want  to  overlj^^Bj)hasi2e  these  differences,  they  do 
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Figure  1 
Research  Paradigms 


Subject-  Axiology: 
Research  Interests  Ontology  Object  Purpose:  Explanation:       the  role 

Paradigm  (Nature  of  Reality)  Relationship  Generalization  Causality        of  values 


Positivistic 


To  explain 
To  control 
To  predict 


Given,  single, 
tangible,  fragment- 
able,  convergent 


Independent , 
neutral  , 
val  ue- free 


Context  and  time  free 
generalizations;  Law-like 
statement  (nomothetic); 

deductive 

quantitative 

focus  on  similarities 


Real  causes, 
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Value  - 
free 


Interpretive 


^3 


To  understand, 
to  interpret, 
(mutual/shared 
understanding) 


Constructed,  multiple, 
whol istic ,  divergent. 


Inter- rel ated , 
relationship 
influenced  by 
subjective 
factors 


Context  and  time  bound 
working  hypotheses; 
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inductive;  qualitative; 
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Interactive 
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method  and 
analysis 


Critical 


Emancipation 
to  critique 
and  1 0  Iden ITf y~ 
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change 


Constructed  ,•  mu.l  tiple , 
wholistic,  divergent 


Inter-related, 
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influenced  by 
strong  corimitt- 
inent  to  human 
emancipation 


Same  as  for  interpretive 


Value- 
bound;  

Critique  of 
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exist.    For  this  reason,  it  is  difficult  to  interpret  findings  from  a  study  within 
the  interpretive  paradigm,  using  naturalistic  methods,  in  light  of  findings  from 
within  the  positivist  paradigm,  using  quanitative  methods. 

Inquiry  within  the  three  paradigms  is  conducted  in  differing  manners.  The 
results  aimed  for  are  different.    I  point  out  the  differences  not  to  set  up  a 
"straw  man"  for  the  purpose  of  justifying  a  "not  so  new"  approach,  but  to  identify 
the  need  to  be  clear  on  what  it  is  we  want  to  investigate. 

The  differing  world-views  that  are  the  bases  for  the  three  research  paradigms 
need  to  be  examined  closely  by  researchers.    The  world-views  define  a  certain 
orientation  toward  the  world.    They  provide  ways  of  seeing  the  world,  and  events 
and  people  within  that  world. 

In  conducting  research  within  the  context  of  education,  the  process  of 

schooling  is  also  viewed  differently  within  the  framework  of  the  three  paradigms. 

Whether  we  look  at  schooling,  learning,  learners,  outcomes  of  education,  curriculum, 

etc.,  each  of  these  have  a  special  meaning  for  researchers.    For  example,  if  I 

were  to  talk  about  the  learner  (subject)  within  the  interpretive  approach,  I  would 

define  the  situation  as  follows: 

As  individuals  begin  to  interpret  reality  about  them,  processes  of 
self-reflection/introspection  and  communication  (external ization) 
of  internal  processes  need  to  be  considered  by  the  researcher.  Each 
individual  learner  is  seen  as  a  "meaning-maker",  i.e.,  creator  of 
their  own  reality.    At  the  same  time,  the  individual  interpretations 
of  reality  are  open  to  critique.    This  leads  to  the  notion  of  critical 
thinking  as  it  applies  to  an  individual's  interpretation  of  their  con- 
text.   To  gain  an  understanding  (interpretive  approach)  of  an  individ- 
ual 's  perception  ofjriaTU^  

th~eT'esearcher  i^^^     enter  into  a  dialogic  relationship  with  that 
individual . 

Entering  into  a  dialogic  relationship  with  an  individual  can  be  most  effectively 

achieved  through  naturalistic  research,  within  the  interpretive  approach.  Dialogue 

is  the  "encounter  between  men  mediated  by  the  world,  in  order  to  name  the  world" 

(Freire,  1970,  p.  76).    There  are  certain  conditions  required  of  subjects  who  enter 

into  dialogue: 

1.    a  profound  love  of  men  o -j 
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1. 

humility 

z. 

an  intense  faith  in  man  (this  is  an  a  priori 

faith  in  the  person) 

trust  (established  through  dialogue) 

5. 

hope  (rooted  in  the  person's  incompleteness. 

and  recognition  of 

that  incompleteness;  constant  search) 

6, 

critical  thinking  (Freire,  1970,  pp.  78-82). 

These  requirements  demand  total  commitment  to  the  process  of  dialogue  from 
those  who  choose  to  enter  the  dialogic  relationship.    They  are  neither  naive  nor 
unworkable.    They  become,  for  subjects  engaged  in  emancipatory  praxis,  a  basic 
orientation  to  life. 

The  term  critical  thinking,  as  a  necessary  element  in  dialogue,  needs  to  be 

pursued  and  delineated  further.    Critical  thinking  is  thinking  which 

discerns  an  indivisible  solidarity  between  the  world  and  men  and 
admits  of  no  dichotomy  between  them  —  thinking  which  perceives 

  real  i  ty  as-process  ,-as-transformati-on,-rathen- than  as  stati  c_   

entity  ~  thinking  which  does  not  separate  itself  from  action, 
but  constantly  inimerses  itself  in  temporality  without  fear  of  the 
risks  involved.    Critical  thinking  contrasts  with  naive  thinking, 
which  sees  'historical  time  as  a  weight,  a  stratification  of  the 
acquisitions  and  experiences  of  the  past,'  from  which  the  present 
should  emerge  normalized  and  'well-behaved.'    For  the  naive  thinker, 
the  important  thing  is  accomodation  to  this  normalized  'today.'  For 
the  critic,  the  important  thing  is  the  continuing  transformation  of 
reality,  in  behalf  of  the  continuing  humanization  of  men  (Freire,  1970, 
p.  01). 

Dialogue  requires  critical  thinking  and  is  capable  of  generating  critical 
thinking.    Communication  is  based  on  dialogue,  and  education  is  based  on  communi- 

 caticn.    Cdmmuni cation  is  concerned  with  meaning,  understanding.    Relating  under- 

 _ standing  to  critical  thinking  and  interpretation  roots  emancipatory  education. within 

the  critical  approach.    In  the  critical  approach,  the  paradigm  for  knowledge  is 
no  longer  the  "observation"  but  the  "dialogue"  (Habermas,  1973,  p.  11). 

I  recommend  that  researchers  interested  in  research  using  the  interpretive 
and/or  critical  paradigms  become  grounded  in  the  work  of  Paulo  Freire  (1970,  1973). 
Freire  worked  with  the  peasant  population  of  Brazil.    His  concern  was  centered  on 
adult  literacy  education  and  his  wor^^^gre  a  powerful  example  of  using  visuals 
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within  an  educational/learning  situation.    His  work  also  exemplifies  the  differing 

world-view  offered  by  an  interpretive  approach  to  research  and  its  impact  on  the 

(3) 

subjects  within  the  literacy  project.' 

I  offer  the  following  ten  points  as  elements  of  Freire's  theory  of  knowledge 
(epistemology)  which,  I  believe,  are  also  the  basic  elements  that  ground  the  inter- 
pretive and  critical  approaches  to  social  and  educational  research.    These  ten 
points  can  provide  guidelines  for  developing,  research  endeavors  using  visuals. within 
the  interpretive  and  critical  paradigms. 

1,  World-view  -  Freire  adheres  to  a  world-view  that  identifies  the  subject 
in  relation  to  a  particular  context  ("I  am  myself  and  my  circumstance"); 

2,  Subjectivism  -  Acknowledging  a  world  of  nature  independent  of  individuals 
does  not  negate  individual  experience  of  that  world  and  the  creation  of 

a  social/cultural/human  world  which  itself  is  a  reality  (cf.  Matthews, 

 1980,  p. -89-)-;   ■   

3.  Abstraction  -  The  individual  mind  plays  an  important  part  in  acquiring 
knowledge.    The  world  (context)  "as  it  is  conveyed  and  verbalized  in 
people's  knowledge,  is  a  world  composed  of  abstractions  and  is  demacrated 
by  concepts,  .  .  .  People  never  just  see,  just  experience,  just  discover; 
they  always  see  and  discover  particular  things,  depending  on  what  is 
already  in  their  heads"  (Matthews,  1980,  p.  90); 

4.  Codification  -  Consists  of  re-presenting  the  "object  of  reflection"  to 
the  subjects  in  a  form  identifiable  to  them,  and  related  to  their 
experience.    For  example,  Freire  used  photographs  and  drawings  depicting 
the  existential  situations  of  the  people  with  whom  he  worked.  The 
visuals  used  were  familiar  to  his  subjects  because  they  contained 
situations  and  events  based  on  the  subjects'  own  descriptions  of  their 
life-situations.    These  "codified"  visuals  become  the  objects  that 
mediate  the  subjects  in  their  critical  analysis.    The  codifications  become 
"cognizable  objects,  challenge^^^ards  which  the  critical  reflection  of 
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the  decoders  should  be  directed"  (Freire,  1970,  p.  107).  The 
cognizable  objects  (visual  re-presentations  of  the  subjects  in  life- 
situations),  posed  as  problems  to  the  subjects,  depict  the  situationality 
of  the  subjects.    Self-reflection  upon  this  situationality  is  reflection 
about  the  very  "condition"  of  existence,  namely,  "critical  thinking  by 
means  of  which  men  discover  each  other  to  be  'in  a  situation'"  (Freire, 
1970,  p.  100).    When  this  situation- (context)  is  seen  as  an  "objective- 
problematic  situation,"  subjects  reach  the"  stage  wherein  the  ability  to 
intervene  in  their  self- formative,  historical  context  becomes  a  possibility. 

Intervention  in  reality  —  historical  awareness  itself  ~  thus 
represents  a  step  forward  from  emergence,  and  results  from  the 
conscientizacao  of  the  situation.    Conscientizacao  is  the  deep- 
ening of  the  attitude  of  awareness  characteristic  of  alV 
emergence  (Freire,  1970,  pp.  100-101). v^) 

Decodifi cation  -  Consists  of  teacher-student,  students-teachers  reflecting 
critically  (dialogics)  on  the  mediating  objects  (e.g.  visuals)  thus 
externalizing  their  "thematics"  and  consequently  making  "explicit"  their 
"real  consciousness"  of  the  world  (Freire,  1970,  p.  108).    During  this 
time,  through  dialogue,    interpretations  are  challenged  and  understandings 
questioned,  constantly  posing  the  object  of  discussion  as  problematic. 
Through  this  process,  which  Freire  refers  to  as  "conscientization," 
subjects  can  arrive  at  a  greater  awareness  of  the  social  context  which 
forms  their  lives,  and  also  create  awareness  of  their  capacity  to  intervene 

and  transform,  it  (cf.  Freire,  1970,  pp,  100-118).    - 

The  process  of  decoding  the  mediating  objects  under  analysis  thus 
consists  in  investigation  of  the  subjects'  thinking  concerning  their  life- 
situation.    Thematic  investigation,  which  deepens  historical  awareness, 
becomes  educational.    At  the  same  time  "all  authentic  education  investigates 
thinking"  (Freire,  1970,  p.  101).    Investigating  the  subjects'  thinking 
leads  to  further  investigation,  hence  education  and  thematic  investigation 

are  "simply  different  moments  of  the  same  process"  (Freire,  1970,  p.  101). 
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When  subjects  begin  to  make  explicit  their  views  of  the  world, 
they  begin  to  see  how  'they  themselves  acted  while  actually  experiencing 
the  situation  they  are  now  analyzing,  and  thus  reach  a  'perception  of 
their  previous  perception'"  (Freire,  1970,  p.  108).    Achieving  this 
awareness,  reality  is  perceived  differently:    "By  broadening  the  horizon 
of  their  perception,  they  discover  more  easily  in  their  'background 
awareness'  the  dialectical  relations  between  the  two  dimensions  of 
reality."    Thus  the  process  of  decodification  brings  about  new  perceptions 
and  the  development  of  "new  knowledge"  (Freire,  1970,  p.  108); 

6.  Distancing  -  Knowing  demands  that  we  gain  some  distance  from  the  "knowable 
object"  (existential  situation).    Individuals  "need  to  stand  back  and 
reflect  on  their  situation  as  an  object  of  knowledge"  (Matthews,  1980, 

p.  91); 

7.  Agency  -  Agency/activity  is  a  prerequisite  for  knowledge.    Knowing  demands 
activity,  and  is  an  active  process.    "Knowing  is  the  task  of  subjects, 

not  of  objects.    It  is  a  subject,  and  only  as  such,  that  a  man  or  woman  can 
really  know"  (Freire,  1973); 

8.  Problem-Posing  Learning  -  This  is  done  at  the  level  of  decodification.  It 
means  asking  questions  about  the  codified  object,  and  "calling  into 
question",  challenging  perceptions  and  interpretations.    It  is  an  unmasking 

of  "soci al  constra-i nts"  .and , . go.i ng  .a„  step  _f urther,-.questi on i ng .  the...^^^   

9.  Holistic  Viewpoint  -  For  Freire,  to  know  things  (objects)  is  to  know 
things  in  relation.    "To  know  a  part  is  to  know  how  it  connects  with  the 
whole.    In  the  process  of  codification,  different  impressions  of  the  same 
object  or  process  are  utilized  so  that  interrelations  might  be  recognized. 
It^is  the  total  vision  which  we  call  knowledge"  (Matthews,  1980,  p.  93); 

10.    The  Social  Dimension  -  "Just  as  there  is  no  such  thing  as  an  isolated 
human  being,  there  is  also  no;;|0^  thing  as  isolated  human  thinking.  In 
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the  act  of  thinking  about  the  object  s/he  cannot  think  without  the 
co-participation  of  another  subject"  (Friere,  1973). 

Conclusion 

The  differing  world-views  of  the  three  paradigms  is  the  point  with  which 
researchers  will  have  to  become  more  familiar.    The  dominant  approach  to  research 
today,  the  positivistic  approach,  is  ingrained  in  our  ways  of  talking  about 
schooling  and  research.    We  will  need  to  learn  a  new  language.    We  will  have  to 
learn  to  live  with  ambiguity.    Certitude  is  not  always  possible.    We  will  need  to 
become  comfortable  with  new  ways  of  looking  at  reality  and  defining  what  is 
legitimate  knowledge.    We  will  have  to  concern  ourselves  with  epistemology. 

Perhaps  we  should  concern  ourselves  less  with  creating  "effective"  visuals, 
or  even  trying  to  define  elements  of  effective  visuals,  and  focus  our  attention 
on  developing  critical  thinking  skills.    Materials  are  readily  available  to  us. 
Moving  beyond  the  visual  to  the  use  of  language  in  interpreting  visuals  offers 
great  research  potential  regarding  how  individuals  come  to  grips  with  their  world. 
Arnold  Wesker,  in  an  insightful  essay  entitled  Words  As  Definitions  of  Experience 
(London:    Writers  and  Readers  Publishing  Cooperative,  1976)  has  already  offered  us 
an  exciting  possiblity  for  blending  research  on  visuals  and  the  use  and  power  of 
language.    The  interpretive  and  critical  paradigms  for  research  should  offer  new 
directions  and  possiblities  for  future  endeavors. 
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Footnotes 

1.  Also  see  Anthony  Giddens.    New  Rules  of  Sociological  Method:    A  Positive 
Critique  of  Interpretive  Sociologies  (New  York:    Basic  Books,  Inc.,  Publishers), 
1976;  Egon  G.  Guba  and  Yvonna  S.  Lincoln.    Effective  Evaluation  (San  Francisco: 
Jossey-Bass  Publishers),  1982;  Gail  McCutcheon.    "On  the  Interpretation  of  Classroom 
Observations",  in  The  Educational  Researcher,  May,  1981;  Richard  J.  Bernstein. 

The  Restructurring  of  Social  and  Political  Theory.  (Pennsylvania:    University  of 
Press),  1978;  Egon  G.  Guba.    The  Context  of  Emergent  Paradigm  Research.  Paper 
presented  at  A  Career  Development  Seminar,  Center  for  Public  Affairs  and  the  School 
of  Education,  University  of  Kansas  and  The  University  Council  for  Educational 
Administration,  Overland  Park,  Kansas,  November  4-5,  1983;  and  Egon  G.  Guba  and 
Yvonna  S.  Lincoln.    Epistemological  and  Methodological  Bases  of  Naturalistic 
Inquiry.    ECTJ,  Vol.  30,  No.  4,  Winter,  1982. 

2.  C.  Wright  Mills,  in  The  Sociological  Imagination  (New  York:    The  Grove 
Press,  Inc.,  1961),  strongly  states  the  case  for  empirical  investigation  and  the 
need  for  examining  the  part  in  relation  to  the  whole: 

The  specific  methods--as  distinct  from  the  philosophy— of  empiricism 
are  clearly  suitable  and  convenient  for  work  on  many  problems,  and  I 
do  not  see  how  anyone  could  reasonably  object  to  such  use  of  them. 
We  can  of  course,  by  suitable  abstraction,  be  exact  about  anything. 
Nothing  is  inherently  immune  to  measurement.    If  the  problems  upon 
which  one  is  at  work  are  readily  amenable  to  statistical  procedures, 
one  should  always  try  to  use  them.    If,  for  example,  in  working  out 
a  theory  of  elites,  we  need  to  know  the  social  origins  of  a  group  of 
generals,  naturally  we  try  to  find  out  the  .proportions  coming  from 
various  social  strata.    If  we  need  to  know  the  extent  to  which  the 
real  income  of  white-collar  people  has  gone  up  or  down  since  1900, 
we  run  a  time-series  of  income  by  occupation,  controlled  in  terms  of 
some  price  index.    No  one,  however,^ need  accept  such  procedures, 
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when  generalized,  as  the  only  procedure  available.    Certainly  no  one 
need  accept  this  model  as  a  total  canon.    It  is  not  the  only 
empirical  manner. 

We  should  choose  particular  and  minute  features  for  intensive  and 

exact  study  in  accordance  with  our  less  exact  view  of  the  whole,  and 

in  order  to  solve  problems  having  to  do  with  structural  wholes.  It 

is  a  choice  made  according  to  the  requirements  of  our  problems,  not 

a  'necessity'  that  follows  from  an  epistomological  dogma. 

I  do  not  suppose  that  anyone  has  a  right  to  object  to  detailed 

studies  of  minor  problems.    The  narrowed  focus  they  require  might  be 

part  of  an  admirable  quest  for  precision  and  certainty;  it  might 

also  be  part  of  a  division  of  intellectual  labor,  or  a  specialization 

to  which,  again,  no  one  ought  to  object.    But  surely  we  are  entitled 

to  ask:    If  it  is  claimed  that  these  studies  are  parts  of  some  division 

of  labor  which  as  a  whole  constitutes  the  social  science  endeavor,  where 

are  the  other  divisions  of  which  these  studies  are  parts?    And  where  is  the 

'division'  wherein  just  such  studies  as  these  are  put  into  some  larger 

picture?    (pp.  73-74). 

3.  I  have  outlined  Freire's  view  of  education  and  the  implications  his  views 
have  for  the  field  of  instructional  technology. (Koetting,  1981)o 

4.  Freire's  Educational  for  Critical  Consciousness  (New  York:    The  Seabury 
Press),  1973  gives  examples  of  visuals  used  in  the  codification  process.    For  a 
detailed  discussion  of  the  codif ication/decodif ication  process,  see  Freire's 
Pedagogy  of  the  Oppressed  (New  York:    The  Seabury  Press,  1970),  Chapter  3. 

5.  Denis  Goulet,  in  his  introduction  to  Freire's  Education  for  Critical 
Consciousness,  op.  cit.,  draws  the  distinction  between  Freire's  notion  of  problem- 
posing-education  (wherein  the  natural,  cultural  and  historical  reality  in  which 
the  subject  is  iimiersed  is  seen  as  "problematic")  and  the  "problem-solving"  view 
of  education,  wherein 
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An  expert  takes  some  distance  from  reality,  analyzes  it  into  component 
parts,  devises  means  for  resolving  difficulties  in  the  most  efficient 
way,  and  then  dictates  a  strategy  or  policy.    Such  problem-solving, 
according  to  Freire,  distorts  the  totality  of  human  experience  by 
reducing  it  to  those  dimensions  which  are  amenable  to  treatment  as 
mere  difficulties  to  be  solved.    But  to  'problematize'  in  his  sense  is 
to  associate  an  entire  populace  to  the  task  of  codifying  total  reality 
into  symbols  which  can  generate  critical  consciousness  and  empower 
them  to  alter  their  relations  with  nature  and  social  forces  (p.  IX). 
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Philosophical  Foundations 
and  Instructional  Design 
(Curriculum  Theory) 

Our  purpose  for  this  symposium  is  in  keeping  with  last  year's 
original  proposal,  i.e.  to  address,  from  a  different  vantage  point,  some 
major  theoretical  issues  of  our  field,  and  to  stimulate  interest  in 
these  issues  among  members  of  AFCT  and  to  provide  an  oooortunity  for 
dialogue  and  discussion. 

Last  year  my  paper  addressed  the  notion  that  within  the  field  of 
education,  researchers  are  faced  with  competing  educational  philosophies 
that  reflect-divergent    ^terpretations  of  reality,  knowledge  and^vaiuev 
Depending  upon  our  individual  orientation  toward  living  and  our  perception 
of  the  "world"  (our  immediate  social -context) ,  we  consciously/unconsciously 
espouse  a...parti cul  ar  phi  1  os  act  i n  certai  n  ways  wi  thi n 

the  classroom. 

The  major  focus  of  my  paper  was  on  epistemology.    I  tried  to  develop 
an  epistemological  framework  within  which  diverse  modes  of  inquiry  could 
be  used  to  comprehend  reality.    I  identified  the  implications  dii'fering 
modes  of  inquiry  would  have  for  future  research  within  our  field,  specifical^ly 
research  of  a  conceptual /theoritical /phi losophi^^^^^^  I  tried  to 

situate  our  current  practice  and  thinking  in  the  field  within  that 
epistemological  framework,  identifying  the  need  to  generate  diversity  in 
our  reserach  methodology. 

Introductfon:  "SituTt^^^^^ 

This  paper  is  concerned  with  curriculum  theory  and  development,  and 
the  place  of  curriculum  theory  within  the  area  of  instructional  technology. 
Our  field  utilizes  the  instructional  design  model,  or  the  systems  approach 
to  instruction  (e^  Kemp,  1977;  Banathy,  1968;  Gagne  and  Briggs,  1975;  etc.), 
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for  organUing  subject  matter  for  instructional  purposes.    Hence,  our 
field  is  concerned  (or  should  be  concerned)  with  curriculum  theory  and 
development. 

Instructional  design  is  a  valid  model /process  to  utilize  for  organizing 
curricular  content.    It  is  a  very  popular  model.    It  has  strong  historical  . 
roots  within  the  field  of  curriculum  (Kliebard,  1975;  Apple,  1979;  Koetting, 
1979).    Yet  it  is  only  one  model  for  organizing  the  instructional  process. 
When  we  examine  the  notion  of  curriculum  theory,  we  begin  to  get  a  broader 
sense  of  the  complexity  of  the  process  of  schooling. 

I  will  develop  my  paper  as  follows:    I  want  to  identify  the  central  

question  of  curriculum  (what  should  we  teach?)  and  examine  the  notion  of 
curriculum  theory.  I  will  then  look  at  the  implications  for  the  field  of 
instructional  technology  that  r  believe  would -enhance  the  uti^^^ 

med i  a  within  the  f ris true t i  ona 1  proc ess . 

I  chose  to  look  at  curriculum  theory  because,  as  I  hope  to  show,  it 
is  through  an  analysis  of  curriculum  theory  that  we  begin  to  move  toward 
differing  philosophical  viewpoints  regarding  schooling.    This  will  provide 
a  framework  for  viewing  the  instructional  design  model  as  one  means  of 
curriculum  design. 

Curriculum:    What  Should  We  Teach? 

Kliebard  (1977)  has  stated  that  the  central  question  of  curriculum  is 
"What  should  we  teach?"    Asking  this  question,  we  are  immediately  faced 


with  a  series  of  questions/issues: 

1.  Why.  should  we  teach  this  rather  than  that? 

2.  Who  should  have  access  to  what  knowledge? 

3.  Wha^  affects  would  accrue  from  the  study,  particularly  the 
prolonged  study,  of  a  given  domain  of  knowledge? 
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4.    How  should  the  various  parts  of  the  curriculum  be  inter-related 


in  order  to  create  a  coherent  whole? 

Taking  the  central  question  of  curriculum  (what  should  we  teach?)  and 
the  questi,ons  we  are  confronted  with,  namely  the  four  just  mentioned, 
what  definition/understanding  of  the  word  theory  (curriculum  theory),  can 
help  us  come  to  grips  with  our  central  question? 

Kliebard  (1977)  suggests  the  following  meaning  for  the  word  theory: 

Any  more  or  less  systematic  analysis  of  a  set  of  related  _ 
concepts. 

The  systematic  analysis  is  an 

Attmept  to  clarify  what  may  be  initially  vague  concepts  and 
thereby  unpack  the  nature  of  the  problems  under  consideration. 

Thus,  through  systematic  analysis,  we  attempt  to  clarify  the  various 


concepts/understandings  implied  in  our  four  questions. 

ExamDles  may  be  helpful  here.    What  is  implied  in  our  four  questions 
What  are  the  implications,  what  are  the  hidden  notions  we  can  "unpack" 
from  these  questions? 

1.  Why  teach  this  rather  than  that? 

We  can't  teach  everything.    We  need  to  be  selective  and  chose 
what  we  are  to  teach  from  a  vast array  of  information  within 
a  given  field.    What  will  be  the  the  basis  of  our  choices? 
Utility?    Relevance?    Personal  meaning?    Survival  skills'? 
Needs  of  business/industry?    Is  there  an  "accepted"  curriculum/ 
body  of  knowledge  for  each  discipline? 

2.  Who  should  have  access  to  what  knowledge? 

What  critfjria  do  we  use  for  determining  who  gets  what  in- 

formation?    Probable  destination  of  students?  Social   

efficiency?    I.Q.?    Standardized  testing?  Vocational/ 
trade?    Who  determines  what  is  legitimate  regarding  a 
body  of  knowledge? 

3.  What  affects  would  accrue  from  the  study  of  a  given  domain 
of  knowledge? 

Does  the  study  of  mathematics  encourage  rational  thought 
process«»s?    Do  certain  studies  "make  us"  better  oeople? 
Do  the  humanities/cultural  studies  make  us  more  complete 
human  beings?    What  knowledge  is  of  most  worth? 
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4.    How  should  the  various  parts  of  the  curriculum  be  inter- 
related in  order  to  create  a  coherent  whole? 

Schools  are  the  only  "place"  where  reality  is  isolated 
into  disciplines  of  study.    Why  emphasize  the  basics? 
Why  not  organize/integrate  disciplines  through  team 
teaching? 

The  problems  we  are  unpacking,  analyzing  and  trying  to  clarify  are 
philosophical  in  nature.    They  are  concerned  with  the  nature  of  reality 
(ontology);  the  nature  of  knowledge  (epi stemology) ;  the  nature  of  valuing 
(axiology);  the  nature  of  society;  the  purpose  of  schooling;  the  nature  of 
society. 

If  we  pursue  this  kind  of  questionninq,  we  move  into  neglected  areas 
in  curriculum  studies,  for  example 

1.  The  taken-for-granted  reality  of  schooling; 

2.  The  conceptual  emptiness  of  our  notion  of,  and  use  of  the 
term  knowledge; 

3.  The  position  of  value-neutrality  regarding  the  process  of 
schooling;  etc. 

What  we  end  up  clarifying/analyzing  are  our  assumptions  underlying  our 
orientation  to  understanding  "curriculum". 

Implications  for  Instructional  Technology 

If  I  can  accept  the  points  made  up  tq  this  point  regarding  the  central 

question  of  the  field  of  curriculum  (What  to  teach?)  and  the  attendant 

-  questions -raised      -   -  -   - 

Why  teach  this  rather  than  that? 

Who  should  have  access  to  what  knowledge? 

What  affects  would  accrue  from  the  study  of  a  given  domain 

of  knowledge?  .  ^    •  ^        i  4.  j 

How  should  the  various  parts  of  the  curriculum  be  inter-related 
to  form  a  coherent  whole? 

Then  I  can  make  the  following  statement: 
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Teaching  is  essentially  a  philosophical  endeavour  and  there- 
fore educational' activity  can  be  conceived  within  the  con- 
text of  a  philosophy  or  world-view. 

Essentially  we  would  be  examining  our  teaching  activity  through  a  process 

of  self-reflection  based  on  a  philosophical  world-view.    This  is  not  a 

new  idea.    I  think  most  of  what  we  do  in  schools  can  be  examined  within 

the  context  of  particular  framewords.    What  I  am  suggesting  here  that  is 

different  is  the  choice  of  frameworks. 

If  the  statement  I  just  made  on  teaching  can  be  accepted,  we  are 

led  to  different  kinds  of  questions  within  the  field  of  curriculum 

because  we  are  using  a  very  different  kind  of  language,  a  different 

conceptual  framework  that  asks  different  questions  than  we  usually  ask  in 

the  field  of  curriculum.    As  Giroux  (1981)  suggests,  a  different  question 

arises:   „     

Whether  the  new  language  and  concepts  used  are  raising  pro- 
foundly important  questions  and  issues  about  the  curriculum 
itself. 

My  contention  is  yes,  the  new  language  and  formas  of  analysis  will  do  just 
that,  namely. raise  more  profoundly  important  issues  not  only  within  the 
field  of  curriculum,  but  within  our  own  field  as  well . We  will  be  required, 
to  examine  the  disciplines  of  philosophy  of  education,  sociology  of  education 
the  revisionist  historian's  work  on  public  schooling;  etc.    This  will 
certainly  broaden  our  base/perceptions  and  help  us  to  see  the  larger  picture, 
not  just  the  "What  to  teach?" 

Apple  (1982)  has  suggested  that  teachers  today  are  being  de-skilled 

in  the  art  and  craft  of  teaching  because  of  the  form  curriculum  has  taken. 
At  the  same  time,  they  are  being  re-skilled  into  managerial  roles  because 
of  that  form.    The  curriculum  field  can  bring  back  the  art  and  craft  of 
teaching.    Educational  technology  cam  provide  diversity  of  thinking  regarding 
curriculum  and  instruction.    That  would  be  curriculum  theorizing. 
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This  'means  that  we  might  focus  less  on  the  specifics  of  instructional 
design,  and  attend  more  to  the  content  of  instruction  and  to  the  diversity 
of  modes  of  expressing  ideas  for  instructional  purposes.    This  will  require 
that  we  become  familiar  with  the  area  of  curriculum  studies,  and  the 
debates,  issues,  problems  and  concerns  of  that  area  of  study.    For  example, 
current  curriculum  literature  is  critical  of  systems  management  procedures 
used  in  organizing  subject  content  (cf.  Apple,  1979).    These  same  critiques 
can  be  used  in  examing  the  instructional  design  model  as  a  means  of  organ- 
izing the  learning  process.    The  I.D.  model  has  a  constitutive  interest  in 
controlling  that . process. 

Control  is  consitituti ve  of  the  model  itself,  the  nature  of  the  model. 

The  instructional  developer  {teacher hmakes~a-l-l-the-decisit>ns -regarding  

the  organization  and  planning  of  the  learning  process,  and  this  is  done 
usually  prior  to  meeting  students  who  will  undergo  the  -'.struction.  One 
primary  legitimating  factor  for  using  this  "scientific/systematic  approach" 
to  designing  instruction  is  the  objective  nature  of  the  results  planned- for. 
Yet,  methods  of  inquiry  have  constitutive  interests.    Empirical  methodology 
has  ah  Tht'erest'Th  cdri^^^^^  is  Veri f red  "in  praxis  by  examining  the 

instructional  design  model  and  progrmas  that  have  been  designed  according 
to  the  model.    Knowl edge  is  predetermined,  v/hat  students  will  "think,  ^ 
feel  and  learn"  is  predetermined,  by  someone  other  than  the  students.  The 
major  difficulty  with  applying  a  control  model  to  the  learning  process  is 
centered  on  questions  that  point  toward  the  "non-neutrality"  of  education: 
"Whose  knowledge  is  it?   Who  selected  it?   Why  is  it  organized  and  taught 
in  this  way?    To  this  particular  group?"    (Apple,  1979,  p.  7)  .  Linking 
these  questions  with  the  emphasis  on  standardization  of  methodology  and 
outcomes  that  is  characteristic  of  the  instructional  design  model,  and 
the  model's  emphasis  on  control  of  the  learning  process,  any  deviation 
from  predetermined  outcomes  canno^^^  considered.    Thus  all  students  who  go 
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through  the  structured  learning  activities  of  the  model  are  expected  to 
arrive  at  the  same  point  (input-output  model).    I  believe  this  is  a  re- 
ductionist and  simplistic  view  of  education  that  poses  strict  limitations 
on  what  is  determined  "legitimate  knowledge,"  and  how  one  arrives  at 
legitimate  knowledge. 

If  I  focus  on  diverse  forms/modes  of  rationality,  I  can  arrive  at 
knowledge  through  interpretive  understanding  (Verstehen)  and  critical 
science.    In  working  with  symbol  systems,  e.g.  in  analyzing  the  language 
of  film,  the  language  of  video,  the  language  of  photography,  visual 
imagery,  etc.,  I  am  situated  in  another  mode  of  rationality,  I  am  looking 
for  interpretive  understanding.    When  these  interpretations  are  open  to 
critical  analysis,  I  am  situated  in  yet  another  mode  of  rationality,  that 
of  critical  science,  critical  thinking  and  analysis.    The  empirical  model 
of  education  does  not  use/recognize  interpretive  understanding  or  critical 
thinking  as  methodology.    I  suggest  we  explore  alternative  ways  of  organ- 
izing curricula  that  acknowledge  that  students  are  caDable  of  having  valid 
views  of  the  world  and  at  the  same  time  recognizing  that  those  views  are 
open  to -cr~it-ical- analysis.        -    —   

There  are  other  models  of  curricula  organization  that  we  could  explore. 
We  will  need  to  examine  the  literature  outside  of  our  field  that  is  specific- 
ally concerned  with  curriculum  development.    This  could  be  a  fruitful  area  for 
future  research  and  alternative  praxis.    Our  research  efforts  will  be  of  a 
theoretical /conceptual  nature,  and  once  the  theory/conceptual  base  is  clearly 
explicated  (a  legitimate  research  endeavor),  testing  the  frameworks  will 
demand  varied  research  technigues  and  reporting.    Definitive,  generalizable 
conclusions  regarding  the  "one  best"  curriculum  organizational  model  will 
not  be  our  research  aim.    However,  greater  understanding  of  the  complexity 
of  the  curriculum  organizational  process  could  result  and  enhance  our  praxis. 


To  link  the  notions  of  curriculum  and  media  together  will  sugqest 
new  ways  of  looking  at  the  learning  process.    It  will  provide  a  different 
language  and  conceptual  framework  for  looking  at  the  debates,  issues, 
problems  and  concerns  in  our  field. 
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DEVELOPMENT  AND  VALIDATION  OF  A  MEASURE 
OF  COMPUTER  ANXIETY 


by 

Matthew  M.  Maurer 
and 

Michael   R.   SImonson  PhD 

INTRODUCTION 

The  rate  at  which  computerization  Is  propagating  Is  con- 
stantly accelerating.  Thus,  the  need  to  understand  the  effects 
of  computer  usage  on  the  Individuals  Involved  with  computers  Is 
Important.  Many  I nd 1 v 1  dual s  fear  computer  utilization,  and  this 
fear  can  Ue  very  detrimental  to  their  performance  In  a  highly 
compete  r I  zed  env 1 ronment . 

Before  fear  of  computers,  or  computer  anxiety,  can  be  ana- 
lyzed. It  must  first  be  Identified.  The  state/trait  theory  of 
anxiety  proposed  by  Splelberger  C1S72)  was  used  as  a  foundation 
for  describing  the  new  phenomenon  of  computer  anxiety  Identified 
In  this  research.  . 

The  Intent  of  this, study  was  to, develop  a  measure  that  could 
be  used  to  Identify  1 nd 1 v 1  dual s  who  had  a  tendency  to  become  unu- 
sually computer  anxious  when  faced  wjth  a  situation  In  which  com- 
puters were  Involved.  This  tendency  to  become  anxious  Is  called 
the  trait  of  computer  anxiety.  The  actual  development  of  anxiety 
when  the  Individual  Is  Involved  with  computers  Is  called  the 
state  of  computer  anxiety.  The  Computer  Anxiety  Index  CCAIN)  Is 
Intended  to  measure  the  trait  of  computer  anxiety,  and  to  be  pre- 
dictive of  the  development  of  the  state  of  computer  anxiety. 

Three  goals  were  Identified  to  Insure  that  the  final  product 
of  the  study  would  be  a  usable  paper  and  pencil  test  of  computer 
anxiety.     These  three  goals  were  as  follows: 
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1.  Develop  a  general  measure  of  computer  anxiety. 

2.  Gather   Information  to  test  the  rellabMIty  and  validity 
of  the  Instrument. 

3.  Gather  data  to  be  used  as  norm  references  for  the  test. 

Before  the  process  of  developing  the  actual  test  coul d 
begln^  a  clear  definition  of  the  computer  anxiety  had  to  be 
developed  to  guide  the  development  process.  Computer  anxiety  was 
defined  as  the  fear  or  appr-shens  I  on  felt  by  an  Individual  when 
using  computers,  or  when  considering  the  possibility  of  computer 
utilization.  To  further  clarify  the  construct.  It  was  made  clear 
that,  although  ther.e  are  rational  fears  related  to  computer 
utilization,  (e.g.  Job  displacement.  Increased  exposure  to  radi- 
ation from  terminal  screens)  the  fears  that  were  being  addressed 
in  this  study  were  fears  that  could  be  called  "Irrational"  fears 
Ce.r,  Impending  doom  or  sur*e  calamity  because  of  contact  with 
compute  rs) . 

This  definition  Is  quite  helpful  In  guiding  the  development 
of  the  computer  anxiety  measure,  but  to  further  assist  In  the 
development  process,  the  construct  had  to  be  further  described  In 
terms  of  the  observable  behaviors  that  suggest  the  underlying 
feelings  related  to  computer  anxiety.  In  other  words.  It  was 
necessary  to  define  how  we  would  know  If  someone  were  computer 
anxious.  This  Is  Important  since  the  ultimate  purpose  of  the 
CAIN  is  to  predict  the  state  of  computer  anxiety.  Thus,  the 
br-haviors  of  that  state  must  be  Identified  so  that  the  predictive 
riblllty  of     the  test     can  be     validated.     The     following  are  the 
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behaviors  th.t    were  tdentlf.ed  as    being  .ndlctWe     of  computer 


anx 1 ety : 


1.  Avoidance  of  computers  and  the  general  areas  where 
computers  are  located.  . 

2.  Excessive  caution  with  computers. 

3.  Negative  remarks  about  computers. 

^.     Attempts  to  cut  short  the  necessary  use  of  computers. 


METHODOLOGY 


W,th  computer  anxiety  Cearly  defined,  and  Its  Indicative 
behaviors  enumerated,  U  was  possible  to  begin  the  prooess  of 
developing  the  aotual     test  of  computer  anxiety.       It  was  decided 

irf    ,,«e  a    six  point     LIkert    scale  of  agree- 
that    the  test    would    use  a    s i x  po  i 

A  ,>,.,  th»    Hennerson,  Morris  and  FItz-Glbbon 
ment/dlsagreement  and  that  the  Hennerson, 

C1978)  ^do,  of  psychological  test  development  would  be  used. 

The  first  step     In  this  development  process    was  to  generate 
numerous  test     Items  that  would    be  Indicative  of     an  Individuals 
feelings  of  anxiety     toward  computers.     RohnerC1980     had  previ- 
ously developed  a  measure  of  computer  anxiety,  but  It  was  specif- 
ically directed  toward  prospective  feachers,  and  therewere  other 
.inor  problems     Identified  with     It.     However,     the   Items    of  the 
Rohnertest    were  used  to    suggest  other  more    appropriate  Items, 
college     students  were  also  asked  to  generate  statements  reflect- 
ing how  they  fe,t  about  computers.     These  statements   sed  to 

suggest  Items  that  reflected  an  Individual's  feelings  of  anxiety 
toward  computers.     Test  Items  were    generated  that  related  to  the 
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previously  defined,  construct  of  computer  anxiety.  The  specific 
definition  and  the  associated  behaviors  were  used  as  the  Initial 
criterion  for  an  appropriate  Item. 

Once  I  terns  we  re  deve 1  oped,  they  we  re  p 1 1 ot  tested  to  dete  r- 
mine  If  they  were  good  discriminators.  As  a  result  of  the  pilot 
test,  poor  Items  were  Identified  and  eliminated,  and  questionable 
Items  were  modified.  A  second  pilot  test  was  completed,  and  only 
the  best  Items  were  kept  to  make  up  the  final  version  of  the  Com- 
puter Anxiety  Index.  This  rigorous  development  and  pilot  testing 
procedure  accounted  for  the  high  level  of  reliability  that  was 
later  found  to  exist. 

The  next  goal  of  this  project  was  to  determine  the  reliabil- 
ity of  the  test  and  to  gather  Information  to  demonstrate  the 
validity  of  the  test.  College  students  enrolled  In  an  undergrad-- 
uate  Instructional  media  class  at  Iowa  State  University  were  used 
as  subjects  In  gathering  this  Information.  The  reliability  of 
the  test  was  measured  uslng^  two  different  methods.  The  Internal 
consistency  of  the  test  was  checked  using  Cronbach^s  (1970)  coef- 
ficient alpha  formula.  The  students  were  also  tested  and 
retested  with  an  Intervening  period  of  three  weeks  to  test  the 
test/retest  reliability  of  the  measure. 

The  establishment  of  the  reliability  of  the  test  made  It 
possible  to  examine  the  validity,  of  It.  The  validation  portion 
of  the  study  was  done  using  students  In  an  Instructional  media 
class  at  Iowa  State  University  as  subjects.  This  group  was  cho- 
sen because  part  of  their  planned  curriculum  Included  a  two  hour 
laboratory  session  In  which  the  students  were  required  to  work 
with  a  computer . 


323 


ERIC 


Four  steps  were  followed  to  demonstrate  the  validity  of  the 
Computer  Anxiety  Index  (CAIN).  The  first  step  was  to  administer 
the  CAIN  to  the  subjects  two  weeks  before  their  lab  on  computers. 
The  CAIN  was  administered  prior  to  the  subject's  required  use  of 
computers  because  the  CAIN  was  being  developed  as  a  measure  of 
the  trait  of  computer  anxiety  (rather  than  the  state  of  computer 
anxiety)  and  naturally  as  a  predictor  of  the  development  of  the 
state  of  computer  anxiety  under  the  proper  conditions  (I.e.  expo- 
sure to  computers). 

The  second  stv^p  of  the  validation  process  was  to  administer 
the  State-Trait  Anxiety  Index  (STAI)  (Spielberger  1970),  which 
was  intended  as  a  concurrent  measure  of  computer  anxiety.  The 
STAI  was  chosen  as  the  best  measure  to  use  as  a  concurrent  meas- 
ure of  computer  anxiety  because  there  was  no  other  appropriate, 
valid  measure  of  computer  anxiety  in  existence.  However,  since 
the  STAI  is  actually  a  measure  of  general  anxiety;,  the  timing  of 
its  administration  was  considered  crucial  If  It  was  to  be  con- 
strued as, measuring  computer  anxiety.  The  state  portion  of  the 
"STAI  was  administered  to  the  subjects  after  they  were  seated  In 
front  of  their  computers.  The  assumption  was  made  that  If  an 
individual  had  the  trait  of  computer  anxiety  they  would  develop  a 
state  of  anxiety  v^h  I  1  e  seated  before  a  computer,  and  uhls  state 
of  anxiety  could  be  measured  by  the  STAI. 

The  third  step  of  the  validation  process  was  to  actually 
observe  subjects  while  they  were  using  computers.  During  thl5 
observation  session,  a  Judgement  was  made  about  each  individual 
on  his/her  observed  level  of  computer  anxiety.  Subjects  were 
Judged  on  a  three  point     scale,   either  computer  anxious,  neutral. 
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or  computer  comfortable.  Tht,  criterion  on  which  the  subjects 
were  judged  were  tiiose  behaviors  that  were  stated  earlier  as 
being   Indicative  of  the  state  of  computer  anxiety. 

The  final  evaluation  procedure  was  to  compare  the  results  of 
the  three  Independent  mep'-^ures  of  computer  anxiety.  The  STAI  and 
the  observed  measure  ov  computer  anxiety  were  correlated  to  the 
results  of  the  CAIN.  It  should  be  emphasized  that  these  three 
measures  were  each  very  different.  The  CAIN  was  a  measure  of  the 
trait  of  computer  anxiety,  and  the  portion  of  the  STAI  that  was 
used  was  a  measure  of  the  state  of  anxiety.  Both  of  these  meas- 
ures were  administered  using  self-reports,  while  the  third 
meusure  was  an  observational  one.  The  observation  was  also  meas- 
uring the  state  of  computer  anxiety,  while  the  test  was  designed 
to  measure  the  less  transient  trait  of  computer  anxiety.  Since 
these  three  measures  were  each  somewhat  different.  It  was  not 
expected  that  their  correlations  would  be  extremely  high.  To  be 
demonstrative  of  the  validity  of  the  CAIN  however,  the  corre- 
lations of  the  measures  had  to  be  positive  and  significant. 

The  collection  of  normative  d'^.^.a  was  the  third  and  final 
goal  of  this  study.  The  Intent  In  collecting  this  data  was  to 
a  1 1 ow  a  person  who  might  take  this  test  at  a  later  time  to  be 
compared  to  others  who  had  already  taken  the  test. 

The  following  six  groups  were  Identified  as  being  Important 
and   Interesting  to  those  concerned  with  computer  anxiety: 

1.  Computer  professionals 

2.  Those  who  use  computers  on  a  dally  basis,   but  are 
not  computer  users 

3 .  . Educators 
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4.  Junior  high  school  students 

5.  College  students 

6.  Adults  who  fit  none  of  the  above  categories 

Subjects  for  the  collection  of  normative  data  were  solicited 
from  across  the  state  of  Iowa.  They  were  from  schools,  busi- 
nesses and  government  agencies. 

The  Intent  In  gathering  this  data  was  not  to  Identify  scien- 
tifically comparable  random  samples,  but  to  gather  a  large  volume 
of  data.  Therefore  no  scientifically  valid  comparisons  should  bp 
made  between  the  groups  of  subjects. 


RESULTS 

The  computer  anxiety  Index  was  found  to  be  highly  reliable^ 
using  two  methods  of  demonstrating  reliability.  A  group  of  25 
subjects  were  tested  with  the  CAIN,  and  retested  3  weeks  later. 
The  coefficient  of  reliability  for  the  test/retest  situation  was 
.90  (r=.90). 

The  Internal  consistency  of  the  second  administration  of  the 
test  of  the  above  mentioned  subjects  was  checked  using  Cronbach's 
coefficient  alpha  method.  The  coefficient  alpha  was  found  to  be 
.94  (r=.94).  The  Internal  consistency  was  also  calculated  for  a 
second  group  of  randomly  selected  from  the  tests  returned  as  part 
of  the  collection  of  norm  data.  The  coefficient  alpha  for  this 
group  was   .96  Cr=.96). 

The  three  Independent  measures  of  computer  anxiety,  Cthe 
CAIN,   STAI     and  observation)  were     taken  and  they     all  correlated 
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positively  and  significantly  with  each  other.  The  correlation 
constant  of  the  STAI  with  the  CAIN  was  .32  Cr=.32).  With  a  sub- 
ject population  of  111,  this  was  significant  beyond  the  .01  level 
Cp  §  .01). 

The  observation  measure  was  correlated  with  the  CAIN  and  the 
correlation  coefficient  was  .36.  This  too  wss  significant  beyond 
the    .01   level    (p  §  .01). 

The  normative  data  was  successfully  collected  and  compiled. 
Table  1  shows  the  number  of  subjects,  their  means,  standard  devi- 
ations and  the  range  of  scores  for  each  of  the  six  groups.  The 
scores  were  grouped  into  2/10  intervals  and  compiled  into  a  per- 
centile table  (Table   2)  to  allow  easy  comparison. 

ANALYSIS   OF  RESULTS 

The  reliability  and  validity  figures  give  strong  evidence- 
that  the  test  is  measuring  what  it  was  designed  to  measure.  The 
normative  data  gives  some  indication  of  the  normal  range  of 
responses  that  can  be  expected  from  the  t.est.  The  results  Imply 
that  a  necessary  measure  is  now  available  for  future  research  and 
evaluation.  The  stated  goal  of  the  project,  to  develop  a  usable 
measure  of  computer  anxiety,  was  accomplished.  The  test  can  be 
used  as  a  tool  in  career  planning,  and  as  a  test  to  identify 
Individuals   in  need  of  special  training. 

In  addition  to  the  accomplishment  of  the  stated  goals  of  the 
study,  this  study  is  significant  as  an  1 mport ant  f 1 rst  step  in 
the  scientific  examination  of  the  phenomenon  of  computer  anxiety. 
This  study  provides  a  tool   to  use   in  that  examination. 
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One  avenue  of  research  that  Is  suggested  by  this  study  Is  to 
determine  If  the  several  groups  that  were  Inspected  are  In  fact 
as  similar  as  the  normative  data  would  suggest.  Four  of  the  six 
norm  groups  showed  normal  distributions  skewed  to  the  right  (to- 
wards the  positive).  (The  group  called  "other''  was  not  suffi- 
ciently large  to  show  a  regular  distribution,  and  the  teachers 
had  a  skewed  and  elongated  distribution.)  This  is  as  can  be 
expected  for  a  measure  that  Is  examining  a  phenomenon  that  Is 
generally  Identified  as  a  negative  one.  The  d I st  r I  but  I  on  shows 
that  most  people  cluster  around  the  less  anxious  end  of  the  sca- 
le. However,  even  with  a  skewed  distribution,  there  were 
Individuals  in  all  of  the  six  norm  groups  that  were  separated 
from  the  rest  of  the  group  by  at  least  one  full  Interval.  This 
seems  to  Indicate  that  In  all  groups.  Including  people  who  use 
computers  on  a  daily  basis,  there  are  those  who  are  critically 
computer  anxious.  The  examination  of  this  peculiarity  In  the 
d I  St r i but  I  on  of  the  scores  of  the  norm  groups  could  prove  to  be 
very   Interesting  and  enlightening. 

A  second  area  in  which  this  study  could  be  very  valuable  Is 
In  examining  the  change  in  computer  anxiety  following  a  specific 
treatment  or  remediation  activity.  The  CAIN  can  be  used  to  meas- 
ure changes  in  computer  anxiety.  Since  the  reason  for  concern 
about  computer  anxiety  Is  that  it  is  generally  believed  that  com- 
puter anxiety  may  Interfere  with  people's  functioning,  this  test 
can  be  used  to  determine  which  treatments  prove  to  be  most  effec- 
tive   in  reducing  computer  anxiety. 
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CONCLUSIONS 


The  Computer  Anxiety  Index  Is  a  valid  and  reliable  test  that 
can  can  be  usod  to  measure  computer  anxiety.  This  test  has 
several  practical  applications.  It  can  be  used  effectively  In 
the  further  study  of  the  phenomenon  of  computer  anxiety.  It  can 
also  be  used  as  an  evaluation  tool  by  guidance  counselors  to 
Identify  students  that  are  either  well  or  poorly  suited  for 
careers  involving  computers.  It  can  also  be  used  by  employers 
and  educators  to  Identify  Individuals  v;ho  are  in  need  of  special 
curriculum  or  training  programs  to  help  reduce  computer  anxiety. 
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Table   1.     Means,   standard  deviations,   and  ranges  of  CAIN  scores 
by  norm  groups 


College     Junior  Profes- 


student 

high 

Teache  r 

s  i  ona 1 

User 

Other 

Al  1 

N 

1  1 1 

247 

~f  -   

42 

67 

122 

25 

614 

Mean  score 

2.70 

2.21 

2.44 

1.78 

1.99 

2.21 

2.23 

Standard 
dev I  at  I  on 

0.71 

0.67 

0,92 

0  58 

0.54 

0.72 

0    7  2 

Low  score 
Cl   =  lowest 
poss I bl e) 

1 .00 

1.00 

1.00 

1  .  00 

1.  00 

1  .12 

1.00 

High  score 
C6  =  highest 
poss I bl e) 

5.04 

5-04 

4.69 

3.73 

4.28 

4.31 

5  .  04 

Note  -  the  higher  the 

CAIN 

score,  the 

h  I  gher 

the  Individual 

anxiety 

Table  2.     Percentile  table  for  CAIN  raw  scores  by  norm  -oup 


Col  1 ege 
student 

Jun I  or 
hi  gh 

Teache  r 

Prof es- 
s I ona 1 

User 

Other 

Al  1 

1  .  0 

D 

1 

2 

4 

2 

1 

1  .  2 

4 

3 

14 

6 

3 

5 

1.4 

1 

9 

16 

30 

12 

7 

11 

1.6 

4 

18 

24 

45 

23 

19 

20 

1 .  8 

8 

30 

32 

59 

38 

32 

31 

2  .  0 

14 

43  . 

38 

72 

52 

44 

42 

2  .  2 

24 

54 

43 

80 

65 

57 

53 

2.4 

35 

53 

48 

86 

79 

69 

63 

2.6 

47 

72 

55 

89 

78 

72 

2  .  8 

59 

81 

60 

91 

94 

84 

79 

3  .  0 

69 

86 

65 

96 

85 

3.2 

78 

90 

74 

95 

88 

89 

3.4 

86 

94 

83 

97 

97 

93 

3.6 

91 

97 

89 

95 

3.8 

92 

97 

93 

98 

98 

92 

96 

4.0 

94 

95 

97 

4.2 

98 

93 

98 

4.4 

96 

96 

.  98 

4.6 

97 

97 

99 

4.8 

5.0 

99 

99 

99 
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Abstract 


This  paper  focuses  on  how  microcomputer  tedinology  can  be  used  to 
manage  individualization  that  is  based  on  student  differences  in  cognitive  style* 
Generalized  approaches  to  individualization  and  the  management  of 
individualization  are  discussed,  along  with  specific  approaches  based  on  individual 
differences  in  cognitive  style  variables.  Benefits  from  the  use  of  computers  for 
the  management  of  this  type  of  individualization  and  the  requirements  for 
management  with  microcomputers  are  presented.  The  pjaper  concludes  with  a 
discussion  of  practical  issues  and  implications  to  be  considered  in  an 
implementation  of  this  approach. 
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.   Management  Potentials 

The  success  of  any  individualization  approach  in  large  part  depends  on 
how  well  the  process  of  matching  individuals  with  alternative  treatments  can  b^i 
managed.  This  paper  focuses  on  how  microcomputer  technology  can  be  Used  to 
manage  individualization  that  is  based  on  student  differences  in  cognitive  styles. 
Although  this  topic  has  general  relevance  to  the  management  of  individualization 
based  on  measurable  student  differences  on  a  variety  of  dimensions,  attention  will 
be  given  to  considerations  that  can  be  derived  from  the  growing  body  of  research 
on  cognitive  styles  and  its  implications  for  the  management  of  individualization. 
As  background  to  this  topic,  a  generalized  approach  to  the  management  of 
individualization,  traditional  approadies  to  instructional  management  based  on 
cognitive  style  differences,  and  benefits  from  the  use  of  computers  for  the 
management  of  this  type  of  individualization  are  described.  The  final  sections  of 
the  paper  describe  the  possibilities  and  requirements  for  the  management .  of 
individualization  with  microcomputers  and  the  practical  issues  and  implications  to 
be  considered  in  an  implementation  of  this  approach. 

Generalized  Approach  to  the  Management  of  Individualization 
In  defining  the  approach  to  be  taken  to  the  management  of 
individualization,  including  one  based  on  cognitive  styles,  two  component 
processes  must  be  specified:  the  approach  to  individualization  and  the  approach 
to  the  management  of  this  defined  individualization  process.  The  past  decade  has 
seen  significant  progress  in  the  articulation  of  general  approaches  in  both  these 
areas,  such  that  it  is  possible  to  describe  well-defined  and  evaluated  procedures. 

Beginning  with  the  first  component,  specification  of  the  individualization 
approach,  the  approach  defined  by  McCombs  and  McDaniel  (1931)  and  Parkhurst 
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arid  McCombs  (1979)  provides  a  basis  for  the  following  generalizable  working 
model.  This  model  consists  of  the  following  steps: 

1.  Analyzing  the  student  f>opulation  to  identify 
characteristics  related  to  success/failure  in  mastering 
course  objectives; 

2.  Selecting  or  designing  individual  difference  measures  to 
assess  student  characteristics  identified  as  important  in 
step  1; 

3.  Administering  selected  individual  difference  measures 
to  the  target  population  in  order  to  analyze  reliability 
and  predictive  validity,  using  course  performance 
variables  of  interest  as  criterion  variables  (e.g.,  test 
scores,  failure  rates,  learning  times,  etc.); 

4.  Identifying  best  predictors  of  student  performance  with 
current  instructional  approach; 

5.  Defining  alternative  strategies/treatments  for 
accommodating  identified  student  differences; 

6.  Specifying  the  individualization  approach,  including 
types  of  decision  rules  and  procedures,  to  be  used  in 
individualized  assignment  to  defined  treatments; 

7.  Developing  alternative  treatments  and  randomly 
administering  them  to  the  student  population; 

8.  Evaluating  alternative  treatments  and  deriving  selected 
decision  rules; 

9.  Implementing  alternative  treatments  per  derived 
decision  rules  and  procedures;  and 

10.  Evaluating  decision  rule  performance  and  revising  as 
necessary. 

The  end  result  of  the  foregoing  process  is  a  validated  individualization 
approach.  Ideally,  it  is  at  this  point  that  individualization  can  be  implemented  on 
a  full-scale  basis,  thus  necessitating  the  need  for  an  approach  to  the  management 
of  this  individualization  process.  That  is,  a  systematic  procedure  must  be  defined 
for  moving  students  through  the  individualized  program  and  keeping  track  of  their 
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performance  and  progress.  In  defining  the  management  approach,  decisions  need 
to  be  made  concerning  the  degree  to  which  ongoing  research  and  evaluation  will 
be  supported  during  full-scale  implementation.  This  would  allow  the  management 
system  to  be  structured  such  that  data  required  for  research  and  evaluation  can 
be  routinely  collected  along  with  data  used  for  the  management  of  student 
performance  and  progress.  Bozeman  (1979)  discusses  several  other  factors  to  be 
considered  when  defining  the  management  approach,  including  resources  available 
(e.g.y  availability  of  staff  personnel  or  computers  to '  perform  management 
functions),  administrative  support  (e.g.,  commitment  of  upper  level  management 
to  the  individualization  approach),  staff  attitudes  and  competence  (e.g.,  staffs 
perceived  need  for  individualization  and  resulting  need,  for  staff 
development/training),  and  a  variety  of  environmental  factors  (e.g.,  size  of 
school,  number  of  courses  to  be  involved,  etc.). 

Regardless  of  the  sophistication  of  the  designed  management  system  and 
the  degree  to  which  it  supports  research,  the  general  procedures  to  be 
accommodated  in  the  management  of  individualization  include  (1)  administration 
and  scoring  of  individual  difference  measures,  (2)  diagnosis  of  student 
characteristics  and  prescription  of  specific  treatments  or  stratep^es, 
(3)  monitoring  and  evaluation  of  student  performance  on  selected  treatments,  and 
(^)  formatting  of  data  into  necessary  reports  for  both  student  and 
instruct  or/researcher.  These  procedures  are  particularly  well-suited  for 
implementation  with  computer-based  technologies. 

For  example,  Bozeman  (1979)  describes  how  the  conceptual  model  of 
computer-managed  instruction  (CMI)  can  be  used  to  assess  instructional  outcomes, 
update  records,  identify  instructional  needs  through  reports,  and  group  students 
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for  instruction  based  on  specified  individueil  difference  characteristics.  Mclsaac 
and  Baker  (1981)  maintain  that  microcomputers  provide  an  effective  way  to 
implement  CM!  because  they  are  less  costly,  provide  more  direct  control,  and 
allow  better  user  access  and  convenience  than  large  mainframe,  timesharing 
systems.  More  will  be  said  about  the  use  of  microcomputers  for  the  management 
of  individualization  in  the  following  sections.  For  now,  however,  the  discussion 
focuses  on  traditional  approaches  to  individualization  and  the  management  of 
individualization  based  on  cognitive  style  differences. 

The  Management  of  Individualization  Based  on  Cognitive  Styles 
Up  to  this  point,  the  topics  of  individualization  and  the  management  of 
individualization  have  been  treated  in  a  general  way.  Recent  research  indicates 
that  individualization  can  be  maximized  by  using  information  about  cognitive 
sytles,  sometimes  more  broadly  referred  to  as  learning  styles  (e.g.,  Cosky,  1980; 
Dunn  &  Dunn,  1979;  Gregorc,  1979;  Hunt,  1979;  Keefe,  1979;  Lindelow,  1983; 
Warden  &  Royce,  1978;  Whitley,  1982).  Whatever  term  is  used,  it  is  dear  that 
styles  provide  a  theoretically  based,  multivariate  method  for  adaptation  to 
individual  differences.  Styles  include  student  differences  in  cognitive,  affective, 
and  physiological  characteristics  or  ways  of  perceiving,  analyzing,  interpreting, 
and  responding  to  learning  situations  (Cosky,  1980;  Lindelow,  1983;  Wardell  &- 
Royce,  1978). 

Researchers  applying  individualization  approaches  based  on  cognitive  or 
learning  styles  have  generally  handled  the  management  of  this  individualization 
with  manual,  teacher-based  procedures.  That  is,  they  have  implemented  manual 
procedures  for  administering  and  scoring  cognitive  style  inventories,  compiling 
scores  into  student  profiles  that  can  be  matched  with  alternative  treatments, 
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assigning  students  to  these  treatments,  and  administering  appropriate  post-tests 
and  remediation.  Examples  of  these  individualization  approaches  include  Hunt's 
(1979)  implementation  of  a  Conceptual  Level  Matchir.g  Model  for  matching 
students'  stages  of  development  and  present  styles  to  specific  teaching  approaches 
that  differ  in  degree  of  structure;  Anderson  and  Bruce's  (1979)  practical 
application  of  a  plan  for  matching  learning  and  teaching  styles  in  a  high  school 
setting;  and  implementations  of  treatment  matching  approaches  based  on 
cognitive  styles  in  an  elementary  school  setting  (Ellis,  1979;  Epstein,  1981).  In 
each  of  these  examples,  the  primary  responsibUity  for  diagnosing,  prescribing, 
implementing,  and  evaluating  the  individualization  rested  with  the  teachers. 

A  number  of  other  applications  of  individualization  bastd  on  cognitive 
styles  have  used  a  cognitive  mapping  approach  wherein  Hill's  (1975)  Cognitive 
Style  Inventory  provides  a  cognitive  learning  style  profile  that  can  be  used  to 
specify  the  conditions  under  which  a  student  can  best  learn  (e.g.,  Kusler,  1979; 
Str other,  1980;  Whitley,  1982).     Although  some  of  these  applications  utUize 
computers  for  the  analysis  of  inventory  scores,  creation  of  cognitive  maps,  and 
generation    of    learning     prescriptions,    the    total     management     of  the 
individualization  process  is  manually  controlled  by  teachers  and  staff.  Similarly, 
Gavanaugh    (1979,    1981)    describes    a    diagnostic/prescriptive    approach  to 
individualization  based  on  learning  styles  in  a  h'^h  school  setting  where  the 
computer  is  only  used  to  analyze  learning  style  information  and  produce  suggested 
prescriptions  by  subject  for  eacl.  student.     The  management  functions  of 

(a)  monitoring  and  evaluating  student  performance  on  alternative  treatments,  and 

(b)  formulating  data  into  reports  for  students  and  teachers  have  generally  not 
been  computer  supported  in  these  individualization  approaches. 
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That  cc.nputer-based  techniques  can  greatly  enhance  the  management  of 
individualization  based  on  -ognitive  or  learning  styles  has  been  recognized  (e.g., 
Cosky,  1980),  but  to-date  cost^.  of  computer  equipment  have  made  practical 
applications  rare.  The  emerging  microcomputer  technology  is  rapidly  changing 
these  possibilities,  however,  and  provides  an  opportunity  to  overcome  problems 
associated  with  manual  management  of  individualization  and  the  resulting 
limitations  to  individualization.  For  example,  without  the  aid  of  computer 
technology  for  diagnosing,  prescribing,  and  evaluating  student  performance  and 
progress^  teachers  must  spend  considerable  time  in  administrative  and  clerical 
tasks  associated  with  student  management.  In  addition,  complex  decision  making 
is  difficult  and  refined  matches  of  studen*  cognitive  style  differences  with 
alternative  treatments  are  less  likely  to  be  based  on  updated  student  performance 
data.  These  limitations  are  particularly  critical  to  the  emerging  science  of 
individualization  based  on  cognitive  styles— a  science  that  requires  systematic 
analysis  and  decision  making  to  revise  and  present  a  comprehensive  learning 
environment  with  sufficient  alternative  treatments  (Lindelow,  1983;  Whitley, 
1982). 

As  a  final  point,  Lindelow  (1983)  has  m'ade  a  strong  c;se  for  the  position 
that  simply-matching  treatments  to  a  student's  learning  or  cognitive  style  h  not 
an  adequate  procedure.  Rather,  it  is  argued  that  the  judgment  and  expertise  of 
the  educator/researcher  should  be  used  in  determining  how  closely  treatments  and 
styles  are  matched.  Lindelow  (1983)  recommends  a  matchi  ng  approach  which 
periodically  exposes  students  to  demands  that  do  not  precisely  match  their  styles 
in  order  to  develop  their  flexibility  and  abUity  to  select  appropriate  strategies  for 
particular  learning  contexts.    The  use  of  this  more  complex  type  of  matching 
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strategy  is  particularly  well  suited  for  implementation  within  a  computer-based 
management  system. 

The  Use  of  Computers  in  the  Management  of  Individualization 
The    development    of    computer    management    programs    used  in 
individualization  of  instruction  has  followed  that  of  instructional  computing  in 
general.    The  first  CMI  systems  were  designed  for  large  mainframe  computers, 
most  commonly  on  a  timesharing  basis.  An  example  of  an  early  research  effort  in 
CMI    in    the    public    schools    is    WIS-SIM    (Wisconsin    Student  Information 
Management),  a  project  undertaken  by  the  University  of  Wisconsin  beginning  in 
1972  (Mclsaac  &  Baker,  1981).   This  program  ran  on  a  mainframe  computer  and 
stressed  the  grouping  function  of  the  management  process  in  a  variety  of 
curricula.    A  concurrent  study  at  the  same  institution  involved  a  management 
system  called  MICA  (Management  of  Instruction  with  Computer  Assistance).  This 
system  emphasized  the  management  functions  of  prescription  and  diagnosis, 
applied  to  the  tracking  of  individual  student  progress  independent  of  group 
progress. 

In  1977,  the  University  of  Wisconsin  began  working  on  a  microcomputer 
management  system  based  on  the  earlier  mainframe  CMI  efforts.  This  system, 
called  MICRO-CMI,  is  designed  to  handle  both  the  diagnosis  and  prescription 
functions  of  MICA,  as  well  as  the  grouping  capability  of  WIS-SIM  (Mclsaac  & 
Baker,  1981).  The  program  rans  on  a  single  microcomputer.  The  entire  system 
includes  the  microcomputer,  a  printer,  a  sheet  scanner,  and  disk  drives 
(presumably  two).  As  it  has  been  implemented  in  the  McFarland  (Wisconsin) 
Public  Schools,  MICRO-CMI  functions  as  a  tool  used  by  teachers  primarily  to 
recommend  groupings  of  students  for  instructional  purposes,  and  to  generate  a 
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variety  of  reports  for  teachers,  parents,  and  students.  As  an  example  of  its 
grouping  capability,  students  in  reading,  math,  and  science  are  regrouped  every 
two  weeks.  Compared  to  the  50  hours  required  for  the  manual  regrouping  of  200 
students  in  reading,  MICRO-CMI  accomplishes  the  same  job  at  a  higher  level  of 
sophistication  in  less  than  an  hour.  Grades  are  the  criteria  upon  which  grouping 
and  diagnosis  decisions  are  made,  where  grades  presumably  refer  to  measures  of 
mastery  level  of  content  or  skill. 

Two  examples  of  large  scale  CMI  systems  for  the  management  of 
individualization  in  military  technical  training  are*  the  Navy's  CMI  system 
(VanMatre,  1980)  and  the  Air  Force's  Advanced  Instructional  System  (AIS; 
McCombs  &  McDaniel,  1981).  Both  of  these  systems  are  implemented  on  large 
mainframe  computers  and  both  systems  accommodate  a  wide  range  of 
management  options  including  student  diagnosis  and  prescription,  progress 
monitoring  and  management,  test  scoring  and  evaluation,  report  generation,  and 
resource  management.  The  AIS  also  has  the  capability  for  complex 
individualization  decisions  based  on  adaptive  decision  rules  which  utilize  both  pre- 
course  and  within-course  student  information.  In  both  the  Navy  and  Air  Force 
systems,  printers  and  scanners  are  interfaced  with  the  mainframe  computer  to 
provide  a  management  terminal  used  for  inputting  student  data  and  outputting 
student  prescriptions  and  other  management  reports. 

Several  commercial  computer  firms  have  designed  CMI  systems  to  be 
used  in  the  management  of  instruction.  Control  Data  Corporation's  (CDC)  PLATO 
system  and  Hazeltine  Corporation's  TICCIT  system  are  two  well-known  and  widely 
used  examples  of  commercially  available  CMI  systems.  Both  of  these  systems 
were  originally  implemented  on  mainframe  computers,  but  are  currently  being 
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converted  to  microcomputer-based  systems.  The  currently  available  micro- 
PLATO  capability  involves  a  tie  in  to  CDC's  mainframe  to  handle  management 
functions.  A  new  version  of  TICCIT,  MicroTICCIT,  is  now  being  marketed, 
however,  which  combines  the  authoring,  delivery,  and  management  of  instruction 
through  a  micro  network  system.  A  third  commercially  available  system  is 
manufactured  by  WICAT  Systems,  Inc.  WICAT's  capabilities  include  the  handling 
of  CMI  from  several  hardware  configurations  ranging  from  stand-alone  to 
networked  microcomputers. 

Since    the   early    1980's,   there   has   been   a  surge   of   interest  in 
microcomputers  and  their  application   to  instruction  (Charp,    1982).  There 
currently    exists    a   large    number    of    microcomputer    firms   (e.g.,  APPLE, 
Commodore,  IBM)  offering  stand-alone  systems  at  relatively  low  costs.  Dramatic 
cost  reductions  from  mainframe  to  mini  to  microcomputers  have  increased  the 
use  of  computers  in  education.    This  phenomena,  combined  with  the  increased 
memory  and  storage  capabilities  of  microcomputers,  have  increased  interest  in 
using  microcomputers  for  more  than  the  delivery  of  instruction,  i.e.,  computer- 
assisted  instruction  (CAD.     Microcomputers  are  now  being  explored  for  CMI 
application  and  can  be  effectively  used  in  the  management  of  individualization 
based  on  cognitive  styles.    The  next  section  explores  the  range  of  management 
options  to  be  considered  in  designing  a  microcomputer-based  system  that  can 
manage  cognitive  style-based  individualization. 

Range  of  Management  Options 
In    designing    a    management    system    to    be    implemented  via 
microcomputer,  two  sets  of  options  or  requirements  must  be  considered.  This 
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•section  considers  the  first  set  of  options,  what  functions  are  required  by  the 
management  system  itself;  the  following  section  describes  the  second  set  of 
options,  what  equipment  is  required. 

Bozeman  (1979,  p.  51)  has   defined  CMI  as:  .  .  management 

information  systems  designed  to  support  certain  management  functions  (e.g., 
planning,  organizing,  controlling)  associated  with  individualization  of  instruction. 
The  support  of  decision  making,  in  particular  decision  making  associated  with  the 
identification  of  the  instructional  needs  of  students  and  in  the  selection  of  the 
most  appropriate  instructional  activities  to  meet  these  needs,  is  emphasized  in 
systems  of  CMI." 

The  following  list  contains  most  of  those  functions  which  have  beer«  ^ited 
as  desirable  in  a  computer-based  management  system  (Bozeman,  1979;  McC-^riJ^^. 
1979;  Mclsaac  and  Baker,  1981): 


1. 

Test  administration 

2. 

Scoring 

3. 

Diagnosis 

(t. 

Prescription,  or  treatment  recommendation  and/or  assignment 

5. 

Automatic  brandling  to  on-line  treatments 

6. 

Performance  evaluation 

7. 

'•leport  generation 

8. 

Resource  management  and  scheduling 

9. 

Data  base  ntaintenynce 

10. 

System  evaluation 

Testing  f  unctions  cUiiow  the  system  to  administer  a  test  or  battery  of 
tests  to  measure  a  studenfs  entry  level  characteristics,  including  cognitive  or 
learning  style,  as  well  as  v;ithin-cou:"^e  performance. 
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Scoring  includes  the  scoring  itself  and  the  storing  of  scores  for  buv^r  use 
in  diagnosis  and  performance  evaluation. 

Diagnosis  is  defined  as  the  assessment  of  a  student's  entry  level 
characteristics  based  on  information  obtained  from  precourse  tes*:  scores. 
Depending  on  the  level  of  sophistication  desired,  diagnosis  can  also  be  extended  to 
the  assessment  of  students'  within-course  performance  or  alternative  treertnents. 

Prescripticn  involves  either  recommending  or  assigning  the  student  to  a 
particular  treatment  based  on  the  previous  diagnosis  and  predefined  decis'Oi^  ruWs 
for  matching  student  characteristics  to  treatment  options,  or  to  remediniim 
based  on  individual  performance  evaluations  and  associated  decision  rules. 

Automatic  branching  is  a  capability  that  can  be  used  if  treatments  are 
provided  on  the  computer  in  the  form  of  CAI,  wherein  the  mar^/7.ge:n'?nt  system 
could  automatically  branch  to  the  prescribed  on-line  treatment- 

Performance  evaluation  refers  to  the  assessment  of  a  i-tudent's  level  of 
mastery  on  particular  treatments. 

Report  generation  includes  providing  the  instructor  and/or  researcher 
with  individual  student  data  such  as  test  scores,  cognitive  style  diagnoses, 
prescribed  treatmaits,  and  progress  reports.    Summarized  group  data  could  also 

be  available*  » 

Resource  management  c^d  scheduling  is  desirc.ble  in  those  applications 
where  there  are  limited  resources  (i.e.,  less  than  the  total  number  required  to 
support  all  students  needing  a  particular  resource  such  as  CAI,  sound-slide 
devices,  etc.),  and/or  v/hen  there  is  a  linear  sequence  of  course  units  (i.e.,  no 
flexibility  in  the  order  in  which  the  units  can  be  taken).  If  these  conditions  do  not 
exist,  the  assignment  to  a  particular  resource  can  be  analogous  to  the  assignment 
to  a  particula  treatment. 
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Data  base  maintenance  is  necessary  in  order  for  any  computer-based 
management  system  to  operate  successfully,  i.e.,  data  bases  must  be  initialized, 
updated,  and  maintained.  Data  bases  most  likely  to  be  needed  for  cognitive  style 
management  are  (1)  a  data  base  of  student  information,  including  entry  level  and 
course  performance  data,  (2)  a  data  base  defining  the  course  hierarchy  of 
alternative  treatments,  (3)  a  data  base  containing  the  decision  rule  parameters  for 
each  individualization  decision,  and  W  if  resource  management  is  included  in  the 
system,  a  data  base  containing  the  number  and  types  of  resources  required  for 
each  course  unit— to  be  used  in  determining  resource  availability.  • 

System  evaluation  is  a  management  option  that  consists  of  a  built-in 
evaluation  system  to  aid  the  implementor  or  researcher  in  determining  the 
success  of  the  prescribed  treatments,  and  therefore,  the  appropriateness  of  the 

system's  decision  rules. 

Some  of  these  functions  may  be  considered  optional,  depending  on  such 
issues  a;:,  U)  whether  the  system  will  be  used  by  instructors  only,  or  by  students  as 
well,  (2)  the  balance  between  research  and  practical  implementation 
requirements,  (3)  level  of  financial  and  other  support  allocated  for  the  system, 
and  W  the  level  of  individualization  to  be  addressed. 

It  should  be  noted  that  the  management  options  discussed  thus  far  have 
been  in  the  context  of  CMI  as  defined  by  Bozeman  (1979).  In  individualizing  on 
the  basis  of  cognitive  style,  the  levels  of  individualization  may  range  from  gross 
cognitive  style  differences  to  very  fine-grained  ones.  CMI  is  most  capable  of 
handling  individualization  at  the  gross  level.  As  one  approaches  the  finer 
distinctions  of  cognitive  style,  many  of  the  management  options  listed  above  must 
be  considered  within  the  context  of  a  particular  lesson.    This  moves  one  away 
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from  the  realm  of  strict  CMI,  and  toward  CAL  In  other  words,  within  a  particular 
treatment,  a  student  may  be  tested,  diagnosed,  and  branched  to  a  subtreatment, 
all  within  the  context  of  a  single  on-line  lesson. 

For  example,  if  the  overall  management  system  determines  that  a 
student  is  a  visual  as  opposed  to  an  aural  learner,  it  may  make  assignments  to  a 
treatment  consisting  of  graphic-intensive  CAL  That  lesson  may  begin  with  a  test 
to  determine  a  finer  level  of  style,  say  whether  the  student  is  a  reflective  or 
impulsive  learner.  If  the  student  is  reflective,  the  pacing  of  the  lesson  may  be  put 
under  the  student's  control.  If  the  student  is  impulsive,  the  pacing  may  be  left 
under  the  control  of  the  system  in  order  to  encourage  the  student  to  take  more 
time  to  reflect  on  answers.  Therefore,  another  consideration  in  determining 
management  options  is  how  finely  one  wishes  to  distinguish  cognitive  style 
differences,  so  that  one  will  know  whether  management  options  should  be 
considered  only  on  a  broad  scale,  only  on  a  fine  scale  within  lessons,  or  both. 

!n  summary,  the  designer  must  determine  which  management  functions 
and  what  level  of  individualization  are  necessary  or  desired  in  order  to  evaluate 
the  second  set  of  options  or  requirements,  those  relating  to  computing  hardware. 

Range  of  Equipment  Options 
The  simplest,  least  expensive  type  of  hardware  system  that  could  handle 
CMI  at  some  level  would  be  a  single  microcomputer  used  in  a  manner  similar  to 
that  of  the  MICRO-CMI  project  described  earlier  (Mclsaac  &  Baker,  1981).  It 
should  be  noted  that  this  type  of  system  would  be  a  tool  used  only  by  teachers  or 
research  staff.  Although  the  microcomputer  would  certainly  be  capable  of 
administering  tests  and  presenting  CAI,  it  would  be  impractical  to  attempt  to  use 
a  single  machine  to  test  and  present  instruction  to  an  entire  class  of  students. 
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Tests  would  be  administered  manually,  and  scores  entered  into  the  computer 
program's  data  base  either  manually  at  the  keyboard  or  automatically  by  means  of 
a  scanner.  Once  the  data  bases  are  initialized  in  this  manner,  the  system  would 
be  able  to  manipulate  the  data  in  just  about  any  prescribed  way.  The  MICRO-CMI 
system  was  reported  to  have  the  capability  to  store  data  on  1,000  students  on  a 
single  diskette,  and  through  swapping  diskettes,  do  calculations  on  a  population  as 
large  as  1,000.  The  major  functions  involved  in  management  of  individualization, 
diagnosis  of  individual  need  and  prescription  of  instruction  to  meet  that  need, 
could  be  handled  by  a  single  microcomputer.  Implementation  of  prescribed 
instruction  would  have  to  be  handled  off-line. 

The  major  disadvantages  of  using  a  single  microcomputer  for  CMI  are 
matters  of  inconvenience.  It  would  involve  quite  a  bit  of  diskette  swapping,  it 
would  require  a  relatively  long  compute  time  compared  to  larger  systems,  and  it 
would  be  limited  to  one  user  at  a  time.  The  major  advantage  is  that  a  single 
microcomputer  will  do  the  job  of  managing  instruction,  or  actually  recommending 
management  strategies  to  be  implemented,  at  a  much  more  sophisticated  level 
than  would  be  possible  manually,  for  the  price  of  a  single  system.  MICRO-CMI 
reported  a  cost  of  $15,000  for  initial  aquisition  and  $2,000  per  year  for  operating 
costs,  for  a  total  of  $25,000  for  a  5-year  period. 

Combining  several  microcomputers  together  in  a  network  can  offset 
some  of  the  disadvantages  of  using  a  single  mac±iine.  The  obvious  advantage  is 
that  a  network  is  a  multi-user  system.  This  means  that  the  management  system 
could  take  on  the  function  of  test  administration.  Having  tests  administered  on- 
line would  mean  faster  and  more  efficient  scoring  and  data  base  updating.  It  is 
possible  that  a  network  of  this  kind  could  be  used  to  present  CAI  as  well. 
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However,  if  one  wants  an  overall  management  system  in  operation  that  would 
control  the  presentation  of  CAI,  and  update  the  data  bases  with  information  from 
the  lessons  automatically,  one  would  need  to  consider  an  addition  to  the  network 


such  a  system  (Charp,  1982).  The  increased  storage  capability  of  hard  disks  would 
mean  that  the  management  system  itself,  including  its  data  bases,  could  be 
available  at  all  times,  even  during  the  presentation  of  CAI  lessons  that  might  be 
loaded  separately  from  floppy  disk  drives  at  the  individual  work  stations.  Other 
advantages  of  increased  storage  capability  is  the  possibilities  of  more 
sophisticated  decision  rules,  the  handling  of  resource  management,  and  the 
implementation  of  system  evaluation  functions.  Of  course,  one  would  still  be 
limited  by  the  storage  capability  of  an  individual  conriputer.  It  can  manipulate 
only  as  much  data  as  it  can  hold  at  any  given  time.  This  means  that  some 
functions,  such  as  the  system  evaluation  for  research  purposes,  would  need  to  be 


handled  during  a  time  when  the  system  was  not  managing  students  directly.  A 

final  advantage  of  having  a  hard  disk  drive  is  a  matter  of  convenience  again. 

Diskette  swapping  could  be  eliminated  or  at  least  greatly  reduced. 

Several  computer  companies  are  now  coming  out  with  microcomputer 

network  systems  specifically  designed  f  or  the  training  environment.  For  example, 

Hazeltine's  MicroTICCIT  is  a  system  o:  microcomputers  which  shares  a  hard  disk 

for  storage  of  student  records,  cour .  ■  are,  and  system  software,  including  a 

« 

management  system,  and  a  host  processor  vdth  256K  bytes  of  usable  memory  for 
processing.  This  type  of  system  addresses  the  problem  of  using  microcomputers 
to  handle  complex  management  tasks  without  dependence  on  an  expensive 
minicomputer. 


that  would  provide  greater  storage  capability. 


A  network  of  microcomputers  that  shared  a  hard  disk  drive  would  be 
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Issues  :n  the  Implementation  of  Microcomputers  for  she 
Management  of  Individualization 
Issues  in  two  general  areas  are  of  relevance  to  the  implementation,  of 
microcomputers  for  the  management  of  individualization  based  on  cognitive 
styles.  First,  it  is  important  to  clearly  distinguish  between  what  is  meant  by  the 
management  of  individualization  and  the  actual  presentation  of  individualized 
treatment  alternatives  within  the  framework  of  microcomputer-based  systems. 
For  the  purposes  of  this  presentation,  this  distinction  reduces  to  using  the 
computer  as  a  management  tool  vs.  only  for  the  presentation  of  instruction,  i.e., 
CMI  vs.    CAI.    Because  microcomputers  can  be  used  in  either  capacity  and 
management  functions  can  be  performed  in  both  CMI  and  CAI  applications,  it  is 
necessary  to  determine  which  application  is  most  suitable  to  the  management  of 
individualization.  This  is  particularly  true  if  the  individualization  desired  involved- 
more  than  computer-based,  on-line  treatments  and  makes   use  of  off-line 
treatments  as  is  likely  to  be  the  case  when  individualizing  to  accommodate 
cognitive  style  differences.    As  has  been  suggested  earlier,  a  basis  for  deciding 
whether  a  CAI  or  CMI  approach      the  management  of  individualizaaon  is  most 
appropriate  in  the  adaptation  to  cognitive  style  differences,  is  to  determine 
whether  gross  or  fine-grained  treatment  alternatives  are  required  to  meet  the 
needs  of  a  particular  student  population  and  content  area. 

Second,  it  is  important  to  keep  in  mind  that  the  management  of 
inravidualization  can  be  addressed  in  both  the  context  of  classroom 
implementations  and  the  context  of  research  and  development.  Ideally,  however, 
both  contexts  should  be  considered  such  that  even  in  a  pure  classroom 
implementation,  research  and  evaluation  components  are  present,  and  likewise,  in 
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a  pure  research  and  development  context,  classroom  implementation  issues  are 
addressed.  Consideration  of  this  issue  is  particularly  important  given  the  current 
status  of  research  in  cognitive  styles  and  the  need  for  further  experimentation 
and  exploration  of  research  questions  (Ragan,  Back,  Stansell,  Ausburn,  Ausburn, 
Butler  &  Huckabay,  1979)  .  In  addition,  incorporating  research  and  practical 
implementation  concerns  in  a  microcomputer  system  for  the  management  of 
individualization  increases  the  likelihood  that  management  and  individualization 
decisions  will  have  both  practical  relevance  and  empirical  validity. 

The' preceding  issues  have  implications  for  the  sophistication  needed  in  a 
microcomputer-based  system  for  the  management  of  individualization  based  on 
cognitive  styles,  as  well  as  concomitant  implications  for  the  selection  of 
particular  microcomputer  systems  and  configurations.  In  turn,  these  implications 
have  to  be  considered  in  light  of  practical  realities  in  the  implementation  setting. 
That  is,  both  the  degree  of  sophistication  and  type  of  microcomputer  system 
required  for  the  desired  management  approach  must  be  considered  in  light  of  such 
practicalities  as  available  resources,  staff  commitment,  etc.  As  Lindelow  (1983) 
has  pointed  out,  individualization  efforts  based  on  cognitive  style  or  learning  style 
are  likely  to  fail  if  the  approach  is  too  demanding,  costly  or  difficult,  if  teachers 
are  not  capable  or  committed  enough,  if  the  individualization  philosophy  is 
misunderstood  or  not  implemented  properly,  or  if  insufficient  funds  are  available^ 

For  the  foregoing  reasons,  therefore,  it  is  critical  to  involve  personnel 
who  will  be  part  of  the  implementation  and  evaluation  of  the  management  system 
in  the  design  and  development  of  this  system.  Mclsaac  and  Baker  (1981)  have 
recommended  a  pilot  project  approach  wherein  users  can  be  involved  in  the  design 
and  development  of  the  individualization  as  well  as  its  management.    Such  an 
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approach  can  lead  to  greater  system  acceptance  and  commitment  to  its  successful 
implementation,  as  has  been  noted  in  efforts  to  individualize  on  the  basis  of 
cognitive  styles  (e.g.,  Cavanaugh,  1979,  1981;  Ellis,  1979;  &  Epstein,  1981). 

In  conclusion,  the  management  of  individualization  based  on  cognitive 
styles  is  a  coq|plex  but  realizable  solution  to  the  problem  of  accommodating 
individual  differences,  when  implemented  with  current  computer-^based 
technologies.  The  use  of  microcomputers  for  this  management  promises  to 
provide  both  a  practical  and  cost  effective  approach  to  maximizing  student 
learning  and  motivation. 
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ABSTRACT 

The  major  purpose  of  this  study  was  to  investigate  ti,  jrffectp 
of  programed  tutoring  upon  the  reading  comprehension  of  fourt  -ade 
students  enrolled  in  a  Chapter  1  program.     Reading  comprehen5::i. 
measured  by  the  Reading  Comprehension  Test,   Iowa  Tests  of  Bas.',-:  .v-'-illn, 
Form  1,  Level  10. 

The  subjects  of  this  study  were  69  fourth-grade  students  who 
scored  below  the  37th  percentile  on  the  Reading  Comprehension  Tesc, 
Iowa  Tests  of  Basic  Skills,  Form  8,  Level  9  in  the  Spring  of  1982. 
One  group   (N  =  35)  received  fifteen  minutes  of  programed  re^ading 
tutoring  each  day  throughout  the  1982-83  school  ye^r  as  s  supple- 
ment to  classroom  instruction.     The  H0U7;     ^n  Mifflin  Readlnj_ Series 
was  used  for  classroom  instruction  and  che  Houqht:on  Mifflin  Tutorials 
were  used  for  the  programed  tutoring. 

A  t-test  was  conducted  on  the  two  groups =  pretest  mean  normal 
curve  equivalents   (NCE's)   scores.     This  test  was  followed  by  an  analy- 
sis of  covariance  using  the  pretest  scores  as  the  covariate.  Finally, 
mean  gain  NCE '  s  scores  were  analyzed  using  a  It-test. 

The  results  of  this  study  indicated  that  programed  tutoring  did 
not  significantly  improve  the  reading  comprehension  of  f ourth'-grade 
students  enrolled  in  a  Chapter  1  program  when  mean  NCE's  and  mean 
gain  NCE's  scores  were  analyzed.     A  review  of  the  descriptive  statistics 
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presented  evidence  that  the  experimental  group  did  narrow  the  initial 
gap  between  themselves  and  the  control  gro  ip.     Thirt^--two  percent  of  the 
students  in  the  control  group  showed  a  loss  from  the  pretest  to  the  post- 
test  while  only  nine  percent  of  the  experimental  group  did  so.     The  con- 
trol group's  posttest  scores  displayed  a  greater  varibility  than  the 
group's  pretest  scores  while  the  experimental  group's  scores  varibility 
remained  relatively  unchanged. 
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THE  p:ffect  of  programed  tutoring  upon  the 

Pi^ADTNG  COMPREHENSION  OF  FOURTH-GRADE  STUDENTS 
ENROLLED  IN  A  CHAPTER  1  READING  PROGRAM 

by  Donna  S.  McGrady,  Ph.D. 
Logan-Hocking  School  District 
Logan,  Ohio 

Background 

Over  34  million  dollars  were  allocated  to  school  corporations 
(districts)  in  Indiana  to  conduct  Chapter  1  programs  in  1981-82. 
Nationwide,  over  2.6  billion  dollars  were  distributed  to  the  50  states 
based  on  a  formula  that  takes  into  account  the  number  of  children  living 
in  poverty  in  each  county  of  the  state  and  the  statewide  per  pupil  expen- 
ridtures.     The  distribution  formula  is  specified  in  Chapter  1  of  the  Edu- 
cational Improvement  and  Consolidation  Act  (1981)  which  replaced  Title  1 
of  the  Elementary  and  Secondary  Education  Act  of  1965  and  its  later  amend- 
ments . 

Indiana  school  corporations  that  qualify  for  Chapter  1  funds,  as 
determined  by  Chapter  1  criteria,  may  expend  these  monies  for  remedial 
reading,  mathematics,  or  language  arts  programs.     Over  95,000  students 
received  a  Chapter  1  reading  service  compared  to  26,000  in  math,  and 
2800  in  language  arts  during  1981-82. 

 Programed  tutoiring  wa^  by  only  25  -of  the--189- school  .  .corporations 

of  which  the  Tippecanoe  School  Corporation  (Lafayette,   Indiana)  was  one. 
Since  1976  when  programed  tutoring  was  implemented  in  the  Tippecanoe 
School  Corporation,  TSC  Chapter  1  student  gains  have  been  higher  than  the 
state  wide  gains  as  measured  by  normal  curve  equivalents  (NCE's). 
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The  superior  gains  made  by  the  TSC  Chapter  1  students  who  ha^-..  been 
taught  using  programed  tutoring  would  indicate  that  programed  tutoring 
is  a  viable  method  for  providing  remedial  reading  instruction  for  educa- 
tionally deprived  students. 

in  these  days  of  ever-l^r easing  Federal  dollar  support  for  special 
programs,  it  would  seem  appropriate  to  achieve  the  greatest  gains  possi- 
ble with  the  dollars  that  are  available.     Indications  from  the  TSC  re- 
sults are  that  programed  tutoring  has  the  potential  to  be  an  instruction- 
ally  effective  and  cost  efficient  method  for  use  in  Chapter  1  programs. 

Problem  Statement 

The  purpose  of  this  study  was  an  attempt  to  answer  the  following 

question: 

Do  fourth-grade  students  in  a  Chapter  1  reading  program  taught  by 
programed  tutoring  have  a  significantly  higher  increase  in  reading  com- 
prehension scores  than  those  not  receiving  programed  tutoring  as  mea- 
sured by  the  Reading  Comprehension  Test  (R)  ,   Iowa  Tests  of  Basic  Skii'-s, 
Form  7,  Level  10? 

Basic  Assumptions 

The  following  assumptions  were  basic  to  the  investigation: 

1.  Reading  is  the  most  important  skill  a  child  Isarns  in  school 
because  it  is  vital  for"  success  in  all  school  subjects  and  for 
the  child  to  become  a  literate,  pi    ductive  member  of  society. 

2.  Educationally  deprived  children  should  receive  instruction  in 
deficient  basic  skills  in  addition  to  the  instruction  received 
in  the  classroom — a  basic  premise  of  r.CIA  Chapter  1. 
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3.      Educationally  deprived  students  should  receive  remedial 

reading  instruction  that  provides  the  potential  for  maximum 
gains  in  reading  comprehension. 

Limitations 

First,  second,  and  third  graders  are  served  first  by  the  Tippecanoe 
School  Corporation's   (TSC)   Chapter  1  program  because  these  students  are 
deemed  to  be  the  ones  who  benefit  the  most  from  the  program,  based  on  the 
gains  reported  by  past  achievement  test  scores.     Since  all  eligible  students 
in  the  first  three  grades  were  served  by  the  program,  there  were  no  students 
available  from  these  grades  to  serve  as  a  control  group.     Inclusion  of 
students  from  the  first  three  grades  in  this  study  would  have  strengthened 
this  investigation. 

Sample 

This  study  involved  69  fourth-grade  students  from  six  elementary 
schools  in  a  rural  or  sioburban  setting  of  the  Tippecanoe  School  Corpor- 
ation, Lafayette,  Indiana.     All  students  included  in  this  study  scored  below 
the  37th  percentile  on  the  Iowa  Tests  of  Basic  Skills   (ITBS)  Reading  Com- 
prehension  Test  (R)  r  Form  8,  Level  9  in  May,  1982.     Students  in  the  ex- 
perimental group  were  assigned  on  the  basis  of  tutoring  time  being  a- 
vailable  when  the  student  was  not  in  a  special  class  such  as  art,  music, 
or  physical  education.     Students'   scores  on  the  Iowa  Tests  of  Basic  Skills 
(Spring,  1982)  were  not  a  basis  for  assignment  to  the  experimental  group. 

The  experimental  group   (N  =  35)  received  fifteen  minutes  of  programed 
reading  tutoring  each  school  day  throughout  the  1982-83  school  year  as  a 
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supplement  to  classroom  instruction.     The  control  group  (N  =  34)  received 
no  supplemental  instruction.     Both  groups  received  classroom  instruction 
based  on  the  Houghton  Mifflin  Reading  Series. 

Stimulus  Materials 

The  Houghton  Mifflin  Tutorials  designed  to  be  used  as  a  supplement 
to  classroom  teaching  based  on  the  Houghton  Mifflin  Reading  Series  was 
used  with  the  experimental  group.     The  program^^d  tutorial  teaching 
materials  include  the  Comprehension  and  Word-Attack  (CAWA)   Skills  Books, 
The  Tutor's  Guide  Handbook  and  the  Tutor's  Guide  Item  Programs  Booklet. 

The  CAWA  Skills  Books  are  nonconsmnable  texts  that  contain  programed 
lessons  relating  to  oral  reading,  comprehension,  and  word-attack  activities. 
The  lessons  are  designed  to  teach  the  skills  using  the  same  story  characters 
and  vocabulary  that  appear  in  the  Houghton  Mifflin  Reading  Series  texts. 
The  lessons  in  the  CAWA  Skills  Books  provides  the  pupil  with  experience  in 
the  same  skills  and  in  the  same  sequence  as  those  provided  in  the  classroom. 

Procedure  Description 

The  tutoring  process  was  carried  out  by  36  adult  women  who  were 
trained  to  tutor  during  15  to  20  hours  of  formal  instruction.  Tutor 
training  workshops  were  first  held  in  the  Tippepanoe  School  Corporation 
in  October,   1978,  when  the  Houghton  Mifflin  Reading  Series  was  adopted. 
Approximately  sixty  percent  of  the  tutors  have  worked  in  the  Chapter  1 
tutoring  program  since  its  inception  in  1978.     Two  certified  elementary 
teachers  are  employed  by  Chapter  1  to  directly  supervise  the  reading  tutors. 
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Tutoring  was  done  on  a  one-to-one  basis  between  the  tutor  and  student 
for  fifteen  minutes  each  school  day  throughout  the  1982-83  school  year.  The 
teaching  activities  of  the  tutor  were  tightly  prescribied  by: 

1.  detailed  instructions  that  must  be  followed  explicitly, 

2.  teaching  materials  included  in  the  Comprehension  and  Word-Attack 
(CAWA)   Skills  Books,  and 

3.  the  pattern  of  the  pupil's  successes  and  failures  on  each  lesson. 
A  master  list  specifies  the  order  in  which  the  different  kinds  of 

lessons  are  taught  by  the  tutor.     The  Tutor's  Guide  Item  Programs  Booklet 
gives  step-by-step  instructions  on  how  to  teach  each  kind  of  item.  There 
are  a  total  of  11  Item  Programs,  one  of  which  the  tutor  is  directed  to  use 
by  a  notation  on  the  bottom  of  a  lesson  page  in  the  CAWA  Skills  Books. 

The  procedures  the  tutors  followed  were  highly  individualized  so  that 
the  student  progressed  at  the  maximum  rate  of  which  she  or  he  was  capable. 
The  pupil  was  not  required  to  complete  any  particular  number  of  lessons  in 
one  tutoring  session.     The  tutor  praised  the  pupil  for  every  reading  task 
completed  successfully  by  saying  "good,"  "great,"  "excellent,"  "super," 
or  whatever  words  a  tutor  was  comfortable  using.     If  mistakes  were  made, 
the  tutor  said  "Let's  try  that  again."    The  student  was  given  the  oppor- 
tunity to  discover  the  correct  pronunciation,  response,  or  answer  through 
a  series  of  specified  prompts  the  tutor  gave.     Notation  was  made  by  the 
tutor  of  how  many  tries  or  "runs"  were  necessary  for  the  student  to  achieve 
complete  mastery. 

Instrument  Used  in  This  Study 

The  instrument  used  in  this  study  was  a  paper-and-pencil  test.  The 
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Reading  Comprehension  Test  (R)  of  the  Iowa  Tests  of  Basic  Skills  (ITBS) 
Multilevel  Battery,  Form  7,  Level  10  was  the  specific  instrument  employed. 
The  Iowa  Tests  of  Basic  Skills  Multilevel  Battery  was  designed  to  provide 
comprehensive  and  continuous  measurement  of  growth  in  the  fundamental 
skills  of  reading,  mathematics,  vocabulary,  language,  and  work-study 
(Hieronymus,  Lindquist,   and  Hoover,  1979a).     The  Multilevel  Battery 
encompasses  Levels  9-14  and  was  designed  for  use  at  Grades  3-9. 

There  are  three  major  categories  of  skills  objectives  for  Test  R; 
namely,  facts,   inferences,  and  generalizations.     There  is  a  total  of  16 
skills  objectives  that  are  tested  in  these  major  categories. 


Collection,  Scoring,  and  Reporting  of  Data 

The  Iowa  Tests  of  Basic  Skills  were  administered  to  fourth-grade 
students  in  the  Tippecanoe  School  Corporation  w^.  thin  two  weeks  of  the 
Spring,   1983,  empirical  norm  dates  as  specified  by  the  test  publisher. 
The  tests  were  administered  by  the  school  principal  in  each  individual 
school  building.     Scoring  of  the  tests  and  reporting  of  the  normal  curve 
equivalents  scores  (NCE's)  was  done  by  the  Riverside  Publishing  Company. 

The  previous  Spring   (May,   1982)  the  ITBS  Form  8,  Level  9  was  admin- 
istered to  these  same  fourth-graders  when  they  were  completing  the  third 
grade.     The  NCE's  reading  comprehension  scores  from  this  test  were  used 
as  a  pretest  to  determine  if  the  experimental  and  control  groups  differed 
in  reading  comprehension  at  the  on^et  of  the  experinent. 
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The  Tippecanr.f*  School  Corporation  (as  do  all  other  Indiana  school 
corporations)  reports  Chapter  1  gains  in  normal  curve  equivalents  scores 
to  the  Division  of  Compensatory  Education,   Indiana  Department  of  Public. 
Instruction  on  July  1st  each  year. 

The  normal  curve  equivalents  (NCE's)   score  reported  by  the  testing 
service  converts  percentiles  into  a  normalized  equal  interval  scale  suit- 
able for  computing  and  comparing  gaino  in  achievement.     The  NCE's  score 
has  the  combined  advantage  of  percentiles  and  stanines  since  it  can  be  used 
for  comparing  ^he  performance  of  a  group  with  that  of  a  norm  group.  It 
can  also  be  meaningfully  averaged. 

Research  Design 

The  Stanley  and  Campbell  (1966)  Nonequivalent  Control  Group  Design 
(#10)  was  selected  for  this  study  because  students  could  not  be  assigned 
randomly  to  the  experimental  and  control  groups.    The  Iowa  Tests  of  Basic 
Skills,  Test  R,  Form  8,  Level  9  was  used  as  a  p^retest  to  measure  the  equi- 
valency of  both  groups  in  reading  comprehension. 

The  dependent  variable  was  the  mean  normal  curve  equivalents  (NCE's) 
test  scores.     The  independent  variable  was  the  method  of  instruction.  The 
experimental  group  received  programed  reading  tutoring  in  addition  to  class- 
room instruction.    The  control  group  received  classroom  instruction  6nly. 
Subjects  in  both  groups  scored  below  the  37th  percentile  on  the  pretest. 


Analysis  of  Data 

The  purpose  of  this  study  was  to  investigate  the  effect  of  programed  . 
tutoring  upon  the  reading  comprehension  of  fourth-grade  students  who  at 
the  end  of  the  third  grade  scored  below  the  37th  percentile  on  the  Reading 
Comprehension  Test  of  the  i^^ests  of  Basic  Skills,  Form  8,  Level  9. 
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The  experimental  group  received .fifteen  minutes  of "programed  tutoring 
each  day  during  the  1982-83  school  year  while  the  control  group  re- 

ceived  no  tutoring. 

Reading  comprehension  of  both  groups  was  measured  by  the  Reading 
comprehension  Test  of  the  Iowa  Tests  of  Basic  Skills,.  Form  9,  Level  10. 
'  Students'  scores  were  reported  in  normal  curve  equivalents  (NCE's). 
Normal  curve  equivalents  scores  are  normalized  standard  scores  with  a  .. 
mean  of  50  and  a  standard  deviation  of  21.06.     The  reading  comprehension 
NCE's  scores. 'served ^as  the  dependent  variable.  . 

A  comparison  of  mean  NCE's  scores  for  the  groups  on  the  pretest 
and  posttest  is  presented  in  Figure  1.     The  mean  scores  of  the  two 
groups  were  closer  on  the  posttest  than  they  were  on  the  pretest.  A 
general  observation  could  be  made  that,  on  the  posttest,  the  experimental 
,   group  narrowed  the'  gap  that  existed  on  the  pretest  between  themselves  and 
'the  contrpl  group.     Median  scores  provided  added  weight  to  this  observation 
since  the  median  score  of  the  experimental ^group  on  the  pretest  was  31  as 

,pated  to  a  median  score  of  37  for  the  control  group.     On  the  posttest  ' 
the- experimental  group  median  score  was  40  and  the  control  group's  was 

only  slightly  higher  at  40.214. 

Ihe  frequency' distributions  display  the  range  of  scores  as  well  as  the 
symmetry  of  the  distribution  of  pretest  and  posttest  scores  for  each  group 
(see  Figures  2  and  3)..     The  range  of  scores  for  the  experimental  group  was 
37.  on  the  pretest  and  57  on  the  posttest  compared  to  the  control  group's 
pretest  range. of  17  and  posttest  range  of  4-9.     The  change  in  range  of  the, 
control  group's  scores  indicates' a  greater  varibility  which  i.  borne,  out  ^ 
by  a. standard  deviation  of  5.087  on  the  pretest  and  12.711  on  the  post- 
test.  ..  •  .  ■  . 
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Figure  2 

Frequency  Distribution  oiF  ExperimentaJ  Croup'j 
NCE*s  Scores  on  the  Pretest  and  Posttest 


Figure  ^3 

.  Frequency  Distribution  of  Control  Group's 
NCE's  Scores  on  the  Pretest  and  Posttest 
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Both  groups'  scores  on  the  pretest  wore  negatively  skewed.  On  the* 
posttest,  ths^cpntrol  group scores,  exhibited- nonsymmetri^  and  a  flatter 
curve  than  did  thb;-^perimental  g'toui)''s  scores. 

The  pretest  data  wepe  analyzed  using  Students  t-test  to  deternrinB 
the  equivalence  of  the  sroups,  since  subjects  were  not  randomly  assigned  . 
to  treatment' groups.'^  The  t-test  between' the  mean  NCE's  scorq.  of  27.a^l4 
for  the  experimental  group  and  36.000 ."for  t^ie  control  group  resulted  in  • 
'a  t  of  -4.43Cwhibh  as  signiffcant  at  the' .001  level  with  48.94.  degrees  of 
-freedom.    This'-'arialysis  indicated  thkt  the  groups.were  not  equivalent  at, 
the  beginning  of  the  study.    This  initial  difference  reflected  a  lower,, 

S,  *  ^  .        '  \  ■  .         ^  ,  ,.-...;.>-•• 

mean-NCE's  score  'for  the  experittiental  group.  ^  ' 

The  posttest  scores  were  analyzed  using  an  analysis, of  covariapce. 
There  was"  no  significant  difference  between  the  .experimental  group  and 
the  control  group  on  the  posttest  when  the  pretest' was  used  as  .a;,covar- 
iate'in  the  analysis.     Therefore,  the  two  groups  which  differed  at  the 
beginning  of  the  study  did  not  dif f Ir  at  the  cohciusiron.  of  the  study, 
.  when  the  i,nitial  difference  was  taken  ihto-^account..  \\ 

Although  Cronbach  ^nd  Furby . .(1970)  have  cautioned  against  using 
gain  scores  for  a  measurement  of  change/  the  authors 'did. note  that  gains 
^or  differences  are  worth  estimating  tb  provide  an.inddcatpr-  of  iess-than- 
normal  development  so  that  individuals  may  be  g'iven  k  special' treatment . 
cronbach- and  Furby  st^e  that  -it  is  possible  of  course ,  given  be.fore  and 
after  scores  on  the  same  instrument,  *o  estimate  true  gains  ; of  individual 
and  to  identify  those  who  did  and  d£d>iot  gainV^  C^p.  79). 

in  vi'ew  of  the  fact  that  all  subjects  in  this  study  scored^ below 
the  37th  percentile  on  the  pretest,  it\could  be  i^if erred  ,i:hat  the  reading 
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comtrehension  development  of  these  students  had^^not  kept  pace  with  their 
peers.    Because  of  this  fact  and  the  additional  fact  that  scores _report-  • 
ed  by  Chapter  1  programs  across  the  country  are  for  mean  gain  NCE'-s 
*  scores,  an  analysis  of  gain  scores  was  perfbrmed.  .     ^       - ,V 

The  frequency  distribution  of  subjects'  gain  scores  (pretest  score 
subtracted  f rom.posttest  scores)  is  shown  in  Figure  4.    Appendices  A  and      ■  . 
B  provide  the  NCE's  scores  used  for  the  computations  of  differences.  The 
frequency  distribution  in  Figure  4  indicated  that  the  control  group  had 
eleven  s'ubjecr.s  whose  test  scores  were  lower  on  the  ^^osttest  than  on  tehe-  "  , 
pfetest.     By  contrast,  the  scores  of  only  three  subjects  in  the  ejcperi- 
mental  group  showed  a  decline.    The  range  of -gain  scares  foj  the  experi^ 
mental  group  was  48  while  for  the  control  group  it  was  54.     ...    .  ..  • 

A  t-test  on  the  mean  g\ins  of  the  two  groups  was  performed.     (See  . 

  ,  ,  ....  '  ^  i. 

figure  5)  .     n6  '  significant  difference  (t  =  1.40,  67  d^Br.')  was  found  be- 
tween  the  mean  gain  scores  of  the  groups.  ^  %  ' 

#  *-  ■  '  .  * 

Conclusions  .  .  *  ^       ^  f/ 

An  analysis  of  the  data  fi;pm  this  study  indicated  that  programed 
'tutoring  did  not  significantly  increase  the  reading  comprehension 'o.f^^  _ 
Chapter  1  eligible  fourth-grade  students.     The  fact  that  the  experi-'  ^: 
mental' and  control  groups  were  not  equivalent  at  the  onset,  was  kn  initial  - 
problem  for  the  study.     Since  the  experimental  group's  mean  scores- we«  . 

significantly  lower  on  the'  pretest,  regression  toward  the  mean 'cannot 
■    -     ,  -      ■     '  ■  ■  •  * .    :•  .  =  ■ 

-    be  ruled  out. when  examining  the  gains  mAde  by  this  group.  ;    ,    ,.    .  • 

?  ^         i  • 

A  trend  evidenced  by  the  study,  i.e.  fewex  students  wto  were  tutored 
'   showing  a-loss  between  the  pretest  and  posttest  as  compared. tp';ther  untutored 


\ 

Figure  4 


Frequency  Distribution  of  Subjects'  NCE's  Cain  Scores 


Figure  5 


Comparison  f)ata  for  Mean  Cain  NCE's  Scores 
for  Both  Croups 


Standard 

Standard 

Skew- 

Mean 

deviation 

Error 

Median 

ness 

Kurtosis 

Experimental 

11.057 

10.721 

1.813 

11.250 

-0.112 

4). 334 

Control 

6.912 

13.756 

2.359 

3.500 

0.135 

-0.269. 
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students,  is  supported  by  past  statistics  compiled  by  the  Tippecanoe 
school  corporation.    Another  trend  noted  was  that  students  who  were  not 
tutored  tended  to  exhibit  more  variability  in  their  posttest  as  com- 
pared  to  a  lack  of  variability  in  their  pretest  scores.     Programed  tu- 
toring seems  to  keep  nearly  all  tutored  students  moving  Uward  i^nprove- 
ment  in  their  reading  comprehension  scores.  ( 

Ellson,  et  al.   (1977b)  found  programed  tutoring  to  be  roost  effec- 
tive with  students  in  the  primary  grades  and  students  who  were  experi- 
encing difficulty  with  reading.    Wang,  et  al.   (1981)  reported  that  Title 
1  programs  had  a  postitive  impact  on  reading  achievement  in  the  first 
three  grades  only.    Therefore,  the  results  of  this  study  gave  additional 
support  to  the  previous  findings. 

The  National  Assessment  of  Educational  Progress   (1981)  spoke^of 
students  in  Title  1  programs  narrowing' the  gap  in  reading  achievement. 
The  experimental  group  in  this  study  did  narrow  the  gap  between  them- 
selves and  the  control  grdup  which  began  the  study  with^  significantly 
higher  scores.    However,  the  gains  made  in  narrowing  the  gap  were  not 
great  enough  to  provide  evidence  that,  programed  tutoring  had  a  sta- 
tistically significant  effect  on, reading  comprehension. 

Campbell  (1969)  elaborated  on  the  problem  of  evaluating  the  effec- 
tiveness of  programs  established  by  the  Great  Society  legislation  in  his 
article  on  "Reforms  as  Experiments."    He  stated  "that  specific  reforms 
are  advocated  as  though  they  were  certain  to  be  successful"  (p.  409). 
Because  Chapter  1  is  "believed  to  be  successful,"  school  districts  are 
discouraged  fro.  withholding  remediation  from  eligible  students  by  random 
assignment  of  students  to  control  and  experimental  groups.     This 'study 
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would  have  been  strengthened  if  students  in  the  first  four  grades  could 
have  been  randomly  assigned  to"  experimental  and  control  groups.    A  seines- 
ter  long  experimental  study  would  have  been  another  .preferable  alternative 
to- the  study  that  was -undertaken.    This  would  have  allowed  all  students  to 
receive  at  -least  one  semester  of  tutoring. 

The  data  in  this  study  do  not  present  compelling  evidence  for  the 
use  of  .  programed  tutoring  with  fourth-grade,  Chapter  1  eligible  students. 
Trends  detected  within  the  constraints  of  this  Study  seemed  to  indicate 
that  programed  tutoring  has  a  beneficial,  though  not  significant,  effect 

on  reading  comprehension.  \^ 

■ . .       .  ■  ' 

Recommendations         '  ^ 

Further  research  should  be  undertaken  to  determine  if  remedial  instruc- 
tion delivered  by  a  machine?  specifically  a  microcomputer is  more  effective 
at  the  fourth-grade  level  for  Chapter  1  eligible  students.     In  view  of  the 
fact  that  many  school  districts  are  purchasingr  microcomputers  with  Chapter  1 
monies,  it  seems  appropriate  to  evaluate  this  method  of  instruction  also. 

Campbell  (1969)  has  suggested  that  where  randomization  is  not  feasible 
or  morally  justifiable,  the  regression' discontinuity  design  should  be  used. 
No  Chapter  1  or  Title  1  program  evaluations  included  in  articles  or  reviews 
of  research  used  this  design.     This  design  should  be  used  in  post  hoc  re- 
search on  Chapter  1  programs  where  local  criteria  specifies  a  definite 
decision  point  about  which  students  will  be  served. 

A  pressing  need  in  the  area  of  research  on  effective  methods  to  use 
in  Chapter  1  programs  is  for  longitudinal  studies.    This  type  of  research 
would  be  most  appropriate  in  a  school  district  where  the  same  Chapter  1 
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eligibility  criteria  and  instructional  method  have  been  used  for  several 

years.  o 

One  can  only  wonder  how  long  Congress  will  see  fit  to  fund  Chapter  1  ■ 
programs  if  ..research  studies  do  i?ot  provide  statistically  and  educationally 
significant  results-  '  . 
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Reading  Comprehension  NCE's — Expisrimental  Croup 
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Appendix  \B 
Reading^  Comprehension  NCE's — Control  Croup 
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Naturalistic  Inquiry:  An  Example 
Used  in  Photographic  Research 


'Naturalistic  inquiry  attempts  to  describe  events  in  their  own 
terms.    Although  such  methods  try  to  induce  as  little  experimenter  bias 
as  possible,  early  works  in  anthropology  and  sociology  were  primarily 
descriptive  and  have  been  criticized  for  their  lack  of  objectivity. 
Experimental  studies,  while  not  suffering  from  the  same  type  of  problem, 
may  manipulate  variables  to  such  an  extent  as  to  lose  the  integrity 
of  the  research  question,  or  to  ignore  large  amounts  of  available  data. 

Methods  used  currently  in  sociology,  anthropology  and  psychology 
have  begun  to  add  scientific  and  quantitative  dimensions  to  naturalisVrc- 
data  gathering  techniques.    Kempton  (1981)  has  devised  a  method  for 
quantifying  ^significant  features  of  ceramic  pots.    Szalay  and  Deese  (1978) 
use  an  experimental  method  within  a  subjective  framework  to  study  human- 
attitudes  and  perceptions.    Burton  andRomney  (1975)  employ  multidimensional 
scaling  and  hierarchical  clustering  for  sorting  role  terms.    Such  a 
sorting  task  combines  naturalistic  methods  of  inquiry  with  quantifiable 
data  analysis!  techniques.    This  last  method  is  particularly  useful  for 
analyzing  visual  and  perceptual  data  and  presenting  it  spatially. 

Studies  exploring  the  significance  of  visuals  have  been  plentiful 
in  the  literature  (Fleming  &  Levie,  1978)  (Dwyer,  1978).  However 
little  attention  has  been  paid  to  the  examination  of  differences  in  the 
perceived  meaning  of  pictures  or  to  the  cognitive  processes  used.  The 
present  study  was  designed  as  the  first  in  a  series  of  inquiries  to 
investigate  the  use  of  multidimensional  scaling  tehcniques  for  observing 
and  measuring  underlying  dimensions  commonly  perceived  by  viewers. 
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SUBJECTS 

Fifteen  uaiversity  age  students,  19  to  45  years  old,  weee  selected 
for  the  study.    They  ranged  from  having  -„no  previous  art  background  to 
those  having  2  years  of  graduate  study  in  art.    Cultures  represented  were 
Anglo,  Mexican -American  and  American  Indian.     .  ^ 

MATERIALS 

Sti(nuli  consisting  of  34  colored' photographs  illustrating  a  variety 
of  concepts  were  presented  to  the  subjects.    Sorting  these  stimuli  into 
perceptually  relevant  groups  was  used  as  a  primary  method  for  recording- 
judgments.    Of  the  original'lOO  photographs  selected  to  represent  18 
visual  categories,  the  3.4  pictures  receiving  the  highest  similarity  ratings 
in  a  pilot  program  were  selected  for;;the  "finaV  study.  Stimuli  were  then 
presented  randomly  across  pairs  and  subjects. 

PROCEDURES  -  '  , 

•'  Three  types  of  data  were  collected:  1)  Similarity  judgements  between 
pairs  of  pictures  2)  Interview  information  including  subjects'  verbal 
descriptions  of  picture  groups,  and  3)  Demographic  information ^about 
subjects. 

Similarity  judgments  .  ' 

Similarity  judgments  formed  the  bases  for  a  quantitative,  experimental 
analysis  resulting  in  a  multidimensional  or  spatial  representation  of  the 
stimulus  field.    Subjects  were  given  34  pictures  to  sort  fjnd  were  told  to 
group  them  together  in  any  meaningful  way  they  chose.    When  the  task  was 
completed  the  picture  numbers  were  recorded  by  group  and  interview 
information  was  collected.  -  • 
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A  34  X  34  individual  similarities  matrix  was  constructed  for  each 

subject.    The  lower  half  of  the  matrix  contained  the  scores  and  the  ' 

diagonal  was  eliminated.    A  binary  code  was  used.    Each  of  the  561 

similarity' ratings  was  coded  as  either  1  if  the  stimuli  were  paired  or 

0  if  they  were  not.    Individual  similarity  matrices  were  summed  across 

subjects  and  a  mean  similarity  matrix  for  all  subjects  was  obtained. 

(D 

using  a  special  SAS  procedure  designed  to  accommodate  similarity  ratings 

(Greenbery,  1983). 

The  resulting  proximities,  figures  representing  the  amount  of 
similarity  between  pictures,  were  used  as  the  data' source  for  a  multi- 
dimensional  analysis  using  the  ALSCAL  technique  (Young  &  Lewyckyj,  1 980) . 
Co-ordinates  were  derived  and  proximities  were  plotted  in  multidimensional 
space  to  allow  visual  inspection   of  the  data. 

Multidimensional  scaling  (MDS)  was  chosen  over  factor  analysis  because 
factor  analysis  assumes  a  linear  relationship  between  variables  which 
is  not  always  appropriate  with  perceptual  data. 
Interview  i nformation 

Quantative  data  obtained  from  similarities  measures  and 
multidimensional  scaling  was  matched  withVrbal  descriptors  provided  by 

 the"^bjects^    ^ThisTesuTted^in  subject  generated  labels  to  describe  data 

groups.    Adjective  descriptors  used  alone  to  define  contents  of  a  picture 
are  subjective  and  without  structure.    Similarity  spaces  expressed  as 
proximities,  however,  are  mathematically  derived  and  empirically  stable. 
Adjective  descriptors  used  in  conjunction  with  empirical  data  are  of  use 
In  interpreting  the  resultant  multidimensional  spaces.    In  addition 
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judgment  of  similarities  taken  directly  from  subjects-is  less  susceptible 
to  experimenter  contamination  (Schiffman,  Reynolds  &  Young,  1981.) 

Demographic  information 

Data  was  collected  from  subjects  regarding  age,  sex,. level  of  schooling, 
amount  of  art  background,  ethnic  community  and  photographic  experience. 
This  information  provides  data  for  comparative  analysis  of-  perceptual 
variations  between  cultures,  age  groups  and, educational  backgrounds. 

RESULTS 

The  ALSCAL  analysis  indicated  that  subjects  did  indeed  group 
photographs  together  according  to  certain  similarity  traits  and  that 
these  photographs  had  recognizable  underlying  dimensions.    The  number 
of  co-occurrences  of  stimulus  pairs  was  determined  by  first  constructing 
individual  similarities  matrices  for  each  subject.    These  individual 
matrices  were  then  summed  across  subjects  to  produce  a  single  matrix 
of  means  similarities.    The  proximities,  numbers  reflecting  the  amount 
of  similarity  perceived  between  a  pair  of  photographs,  were  plotted 
spatially  using  the  ALSCAL  procedure  (Young. &  Lewyckyj,  1980, ) 

Similarities  _  1  - 

Data  from  the  Means  Similarities  Matrix  is  summarized  in  Table. 1. 

Insert  TABLE  1  about  here 

Of  561  possible  pairs,  356  occurred  less. than  20  percent  of  the  time. 
However,  there  were  pairs  of  pictures  which  consistently  were  rated 
together  as  often  as  80  percent  of  the  time.    At  the  upper  level,  there 
was  80-100  percent  agreement  on  seven  picture  pairs.    They  were 
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TABLE  1 

DATA  FROM  MEANS  SIMILARITIES  MATRIX  SUMMARIZED  BY 
NUMBER  OF  CO-OCCURRENCES  AND  LEVEL 


PERCENT 

CO-OCCURRENCES 

0-19 

356 

20-39 

90 

40-59 

73 

60-79 

35 

80-100 

7 

*  561  Total 

*  561  represents  the  number  of  pairings  in  a  matrix  defined  by 
34  X  31^-  34. 
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numbers  2  and  26,  12  and  17,  12  and  23,  21  and  24,  13  and  17,  20  and  26, 
and  21  and  34.    Pairs  24  and  34,  and  17  and  23  had  73  percent  agreement.  ■ 
Pictures  12,  17  and  23,  which  had  similar  coordinate  values  were 
described  by  respondents  as  "closeups  of  people,  some  showing  lots  of 
emotion,  and  some  just  riding  on  machines"  (see  Figures  1  and  2). 
Pictures  21,  24  and  34  also  had  high  proximities  and  similar  coordinate 
values,  (Table  2).    Initial  subject  interviews  revealed  that  these  were 
perceived  as  "pictures  of  people  ...  foreigners. . .Africans" . 
Multidimensional  scaling 

Multidimensional  analysis  of  the  individual  similarity  matrices  of 
respondents  indicated  that  the  best  conceptual  space  for  the  picture 
differences  was  three  dimensional.    There  was  a  rapid  drop  in  stress  up 
to  three  dimensions  and  a  corresponding  improvement  in  squared  correlation. 
The  stress  value  for  the  two  dimensional  interpretation  (Kruskal 's 
stress  formula  1 )  was  .209.    The  corresponding  Rsq  was  .830.    The  three 
dimensional  interpretation  contained  greater  information  and  also 
coincided  with  guidelines  for  selecting  dimensionality  (Kruskal  ,»  Wish,  1978) 
Higher- dimensional  solutions  did  not  provide  more  insight  into  the  data. 

The  multidimensional  results  are  shown  in  Table  2  listing  stimulus 
or  picture  number  and  corresponding  coordinates  for  each  of  the  three 
dimensions  analyzed. 

Insert.  Table  2  about,  here 

Each  dimension  was  normalized  to  a  mean  of  0.    The  ALSCAL  procedure 
plotted  stimulus  coordinates  and  through  a  succession  of  iterations 
fit  the  proximities  to  the  distances  providing  a  spatial  representation 
of  the  data,  (Figures  1  and  2).  • 
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TABLE  2 


STIMULUS  COORDINATES  FROM  COMPOSITE  MULTIDEMENSIONAL  SPACE  SIMILARITY 
RATINGS 

Stimulus  Coordinates 


Dimension  V 
Life 

Dimension  2 
Nature 

Dimension 
Culture 

1 

1.33 

-0.57 

.  -1.47 

2 

1.52 

1.52 

0.47 

3 

-0.59 

-0.98 

-0.60 

4  ■ 

-0.65 

-0.93 

0.89 

5 

-1.20 

-0.19 

0.19 

6 

-1.17  / 

0.15 

-0.55 

7 

-1.44 

0.16 

.  0.04 

8 

-1.38 

-0.09 

-0.01 

9 

-0.91 

-0.45 

0.71 

10 

1.31 

-1.79 

0.40 

n 

-0.98 

-0.17 

-1 .04 

12 

-1.36 

0.36 

0.11 

13 

-1.39 

0.17 

-0.40 

14 

'1.19 

O.IO  .. 

-1.66 

15 

1.89 

0.58 

-0.53 

16 

-0.02 

-0.73 

-1  .49 

17 

-1.35 

0.30 

-0.04 

18 

1.36/ 

-1.69 

0.51 

19 

1.62 

1.52 

-0.28 

20 

1.25 

1.68 

0.45 

21 

-0.78 

0.55  ^ 

0.81 

22 

1.15 

-0.01 

-1.82 

23 

-1.25 

0.16 

-0.49 

24 
25 

,>.-*«-*''^51 

0.33 
1.64 

0.73 
0.23 

26 

1.36 

1.53 

0.36 

27 

0.34 

0.31 

1.04 

28. 

1.12 

-1.61 

0.54 

29 

-1.40 

0.14 

0.15 

30 

1.66 

•  -1.38 

0.53 

31 

1.69 

-1.36 

0.19 

32 

-0.56 

-0.21 

1.07 

33 

-1.36 

0.24 

0.12 

34 

-0.76 

0.71 

0.85 
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Interpretation 

When  multidimensional  scaling  properly  analyzes  proximities  data 
from  a  means  similarities  matrix,  the  resultant  configuration  produces 
clusters  with  common  properties  which  are  helpful  in  interpreting 
underlying  dimensions.    In  this  study, interview  information  elicited 
from  subjects  provided  "the  identification  of  dimensions  and  clusters  of 
phrases  and  concepts  for  coordinates  plotted  by  the  ALSCAL  procedure.  This 
produced  dimensions  1  and  2  (Figure  1)  and  dimensions  1  and  3  (Figure  2). 
Subjective  inspection  of  these  figures,  combined  with  subject  interview 
information,  produced  the  interpretation  which  follows.    A  regression 
could  not  be  done  on  this  data  since  the  dependent  variables  were  to 
be  identified  by  the  subjects  during  the  study  and  were  not  available 
a  prio^i . 

The  first  dimension  (Figure  1)  contains  close-up  pictures  of  people 
smiling  and_^  frowning  opposite  pictures  of  mechanical  objects.  This 
dimension  was  labeled  a  "1  iving"-"non-l iving"  dimension,  as' a  result  of  . 
insoection  of  the  Pictures  and  verbal' descriptions  from  subjects.  'Along  tl 

Insert  Figure  1  about  here 

continuum  from  left  to  right  are  pictures  #7  ("close  up  of  a  happy 
couple  kissing")  and  #29' ("medium  shot  of  older  woman  holding  freshly 
baked  muffins  and  looking  worried,  apprehensive").    Moving,  closer  to  the 
center  is  picture  #27  ("long  shot  of  person  preparing  food  or  cleaning 
...other  culture... no  visible  emotion") .    Moving  to  the  right  along 
dimension  1  pictures  #14  and  #22  represent  the  opposite  extreme,  perceived 
as  non-living  objects;    Numbers  14  ("inside  of  a  boat  or  an  airplane") 
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Figure  1.   Dimensions  1  and  2  (unrotated)  of  the  three-dimensional  space  derived  by  ALSCAL 
representing  relationships  between  34  photographs.    Interpretation  of  dimensions  and 
group  descriptions  obtained  from  subject  Interview  data. 
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and  22  (a  steam  locomotive  with  lots  of  energy)  represent  mechanical, 
non-living  but  moving  objects.  Number  15,  the  'fcirthest  toward  the' non- 
living extreme  is  ("geometric. abstract"). 

'     Neighborhood  interpretation  ("Guttman,  1965)  reveals  that  groups  of 
pictures  have  been  described  by  subjects  using  similar  adjectives. 
Pictures  #33,  ^7 >and  12  are  all  described  as  "close-ups  of  people". 
Pictures  20,  25  and  26  are  seen  as  "old  art  and  archeology".  By 
further  relying  on  Guttman 's  (1965)  argument  for  pattern  interpretation 
it  can  be  seen  that  close-up  pictures. of  people,  man-made  artifacts, 
patterns  in  nature, and  nature  pictures  in  snow  tend  to  cluster  together 
in  space.    Inspection  of  the  data 'reveal s  that  clusters  are  small  and 
display  a  high  degree  of  correspondence.    This  is  verified  by  the 
similarities  data  in  Table  Z. 

Interpretation  of  the  second  dimension  as  "nature— man  made'' was 
based  on  subjects'  descriptions  and  the  experimenter's  visual  inspection 
of  the  clusters  found  at  opposite  extremes  of  the  dimension  (Fig.l)°. 
Although  farther  from  the,  center  line,  definite  groupings  are  visible. 
Pictures  numbered  20,  25  and  26  represent  "a  skeleton  carved  in  rock", 
" ''T^GoyaTty^^^  and  "some  old  pictographs  on  rock"  respectively. 

Subjects  referred  to  this  group  as  "old  artifacts,  art  and  archeology". 

\ 

.  ■      '  \  ,  -  . 

They  are  man-made  and  iji  the"non-l iving" quadrant  of  the  dimensional 
space.    As  the  groupings  move  from"man-made"  to  "nature-made",  there  is  a 
cluster  of  nature  pictures  containing  leaf  patterns^  and  hill  contours. 
Farther  toward  the  extreme,  pictu^^es  #28,  18  and  10  are  nature  photograph 
of  "large  cold  spaces".    Dimension  X  the  "living— non-living"  dimension 

\ 

is -^complemented  by  dimension  2  which  reveals  a  "nature-man  made"  spread.; 


n 


The  34  pictures  group- themselves  into  six  neighborhoods  thus  defining 
the  parameters  of  the  dimensions,  -• 

When  dimension  1  is  plotted  with  dimension  3  (Figure  2),  the 
^pictures' of  people  are  broken  out  into  "people  like  us"  and  "people  not 
like  us".    Pictures  #21 ,  34  and  4  suggest  people  from  different  cultures, 


Insert  Figure  2  about  here 


The  dimensional  difference  is  interpreted  as  "western-non-western"  but 
a  broader  interpretation  for  that  dimension  might  be  "cultures  with 
modern  technology"  (pictures  14  and  22)  opposed  to  "fcul tares  without 
modern  technology"  (pictures  27  and  32). 

Discussion 

Dimensions  1  (1  iving— non-living)  and  2  (nature— man  made)  hold 
up  well  as  shown  in^the  tables  and  figures.    Dimension  3  (western  culture 

 non-western  culture)  is  weaker  but  still  emerges  as  a  dimension  of 

primary  consideration.    The  results  of  the  analyses  suggest  that  pictures 
are  grouped  by  viewers  according  to  commonly  perceived  inherent  dimensi^ms.. 
within  the  photograph.    Although  it  is  premature  to  identify  thfe  dimensions 
precisely,  areas  of  universal  dimensionality  were  uncovered  which  should 

.be  tested  further. 

Three  dimensional  aspects;  life,  nature  and  culture  appeared  to 

contaiOriffiar7~vi  sua^  "''^^  ^  • 

suggests  the  existence  of  a  universality  of  meaning  systems  in  visuals. 

Perhaps  the  structure  of  connotative  meaning  in  photographs  is  universal 
whereas  specific  visual  symbols  are  culture  specific. 
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Figure  2.^  Dimensions  1  and  3  (uhrotated)  of  the  three-dimensional  space  derived  by  ALSCAL 


representing  relationships  between  34  photographs. 
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.  Conceptsv-Similar-  to  thi-s  are  supported  in  the  areas  of  linguistics/ 
(Osgood,  1963;  Miller,  1970)  and  "in  visual  pattern  perception  (Deregowski , ' 
1980).    Osgood's  (1964)  semantic  difierential  was  the  result  of  discovering 
three  universal  factors  qr  dimensions  of  meaning  in  the  affectivp  domain: 
'  evaluative  (good-bad),  potency  (strong-weak)  and  activity  (fast-slow). 
The  results  of  the  present  study  suggest  that  there  may  be  universal, 
connotative  meanings  in  pictures  as  well. 

Three  directions  are  suggested  for  future  werk  in  this  area.  In 
order  to  determine  whether  the  dimensions,  suggested  in  this  study  are 
stable,  replication  is  necessary .    First,  using  the  3  dimfensions  as 
'a  priori'  categories,  the  same  .stimulus  set  should  be  used  to  determine 
whether  subjects  continue  to  place  appropriate  pictures  in  the  pre-' 

c  . 

selected  categories.    Using  the  3  dimensions  which  have  emerged  in  this  ' 
study  as  dependent  variables,  a  regression  can  then  be  performed  to 
support  the  multidimensional  analysis,    Second,  another  stimulus  set 
of  .photographs  should  be  selected  to  include  the  same  wide  range  of 
subject  matter,  and  inquiry  made  to  further  explore  the^ perceived 
importance 'of  these  dimensions  (life,  nature  and  culture)  for' other 
visual  images.    Third,  the  importance  of  a  culttfral  dimension  suggests 
eventual  cross-cultural  studies  examining  differences  in  categorization  . 
of  visual  information. 

Discovering  universal  dimensions  by  which  people  categorize  and 
attend  to  visual  information  is  helpful  not  only  in  further  understanding 
the  perceptual  process,  but  in  desigrring  visuals  for  ins^uction. 
Investigating  the  visual  meanings  perceived  by  viewers  may  lead  to  a 
broader  understanding  of  how  cognitive  pfqqesses  interact  with  mediated 
instruction.  /  ' 
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With  the  addition  of  microooraputers  into  the  schools  at  all  levels, 
conputer-assisted  instruction  (CAI)  is  being  integrated  rapidly  into  the 
curriculurai    Mthough  many  "s  ~" 
ocmputers,  their  continual  interest  and  motivation  {ie.,  continuing 
notivation)  to  work  with  CAI  have  not  been  investigated.    (Swenson  &  Anderson, 
1982).    CAI,  however,  has  been  found  to  reduce  instructional  time  by  as  much 
as  one-half  with  no  decrease  in  performance  (Dence*  1980;  Kulik,  Kulik,  & 
Cohen,  1980).    Ihus,  a  student's  willingness  to  return  to  a  oanputer-related 
t^k  may  be  as  ixiportant  an  outcome  as  inproved  performance. 

Feedback  in  CAI  has  been  found  to  improve  student  performance  as  measured 
by  pre-  and  posttest  data.    Both  relevant,  informational  feedback  and  feedback 
contingent  on  student  performance  have  resulted  in  higher  performance 
(Magidson,  1977?  Tait,  Hartley,  &  Anderson,  1974).    In  another  study,  Anandara, 
Eisel,  and  Kbtler  (1980)  reported  that  students  receiving  personalized 
feedback  wrote  better  essays. 

Although  feedback  in  CAI  and  motivation  to  return  to  task  have  not  been 
investigated,  evidence  fron  related  areas  suggests  that  encouraging  conments 
or  praise  can  influence  motivation.    In  a  review  of  the  literature  on  teacher 
praise,  Brophy  (1981)  reported  that  praise  should  be  individualized,  and  should 
refer  to  the  student's  performance  on  the  task  in  order  tOvbe  effective.  Fran' 
research  in  the  area  of  intrinsic  motivation,  positive  ocninents  given  in  a 
one-to-one  situation  led  to  increased  motivation  with  kindergarten  children 
.    (Anderson,  Manoogian,  &  Reznick,  1976),  fourth  graders  (Sarafino  &  Stinger, 
1981),  and  high  school  students  (Harackiewicz,  1979).    Oaments  referring  to  a 
student's  increased  con^petence  at  a  task  also  appear  to  be  related  to 
increased  motivation.   Both  eleraentary  and  college  level  students  have 
returned  to  task  at  a  greater  rate  as  they  have  felt  more  competent  on  the 
initial  task  (Arnold,  1976>  Boggiano  &  Ruble,  1979). 

There  is  sane  evidence  that  both  oonnents  and  CAI  may  have  a  differential 
effect  based  on  sex  of  subject.    Males  who  received  positive  conments  returned 
to  task  more  frequently  con^ared  to  males  who  did  not,  whereas  the  opposite 
occurred  with  fenales  (Deci,  1971,  1972).    Boys  and  girls  also  seem  to  choose 
different  coiputet-related  tasks  (Swigger.,  Garapbell,     Swigger,  1983).  \ 

Task  difficulty,  interest,  and  task  enjoyment  are  other  factors  which 
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appear  tx>  influence  cx>ntinuing  motivation.    Barter  (1975)  has  found  that  boys 
appear  to  have  a  greater  desire  than  girls  to  solve  challenging  problems, 
while  girls  have  a  greater  need  for  social  approval.    However,  neither  boys 
nor  girls  will  select  tasks  they  think  are  too  difficult  (Barter,  1978).  In 
■  addition,  interest  and  task  en joj^ntiwe^  related  to  continuing 

motivation  in  a  study  with  fifth  graders  (Mosley,  1983). 

The  present  study  was  designed  to  investigate  the  effects  of  two  feedback 
conditions  on  the  motivation  of  bciys  and  girls  to  continue  with 
ocnputer-'assisted  instruction.    Two  ccnment  conditions  (connient,  no  ooRiuant) 
were  crossed  with  sex  of  subject.    As  is  connon  in  motivation  research, 
subjects  who  chose  the  oonputer  for  the  next  task  were  judged  as  showing 
continuing  motivation.   CJuestionnaires  %^ere  used  to  collect  data  on  other 
factors  related  to  continuing  motivation  such  as  conqpetenoe,  interests,  and 
task  difficulty. 

METHOD 

Subjects 

Sixty-two  (62)  si^th-^rade  studentis,^9~bcys  and  33  girls^^  from  a 
suburban  elementary  school  participated  in  the  study*    The  sc*ool  was  in  a 
middle  class  socioeconomic  area.    Students  were  familiar  with  the  operation  of 
the.  school  microocnpiters. 

Procedures 

Trained  experimenters  administered  the  study  in  the  sciicjol  computer  lab# 
Fourteen  Atari  800  microcoriputers  on  a  networking  system  were,  used.  Subjects 
completed  a  questionnaire  and  preteist  before  beginning  a  CM  unit.  They 
worked  on  the  unit  at  their  own  rate.    As  subjects  finished;  they  .were  given 
the  post  test  and  second  questionnaire. 

Six  sessions  were  conducted,  each  lasting  approximately  30-35  minutes. 
Students  within  each^of  three  classes  were  assigned  randomly  to  one  of  two 
treatment  groups:    ooninent  or  no  coninent.    Only  one  treatment  was  administered 
during  earfi  session.    All  subjects  ocnpleted  the  same  CAI  ,unit  on  flow  chart 
symbols.    They  also  received  knowledge  of  correct  results  personalized  with 
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their  names  during  the  three  practices  in  the  unit.    In  addition,  the  oonment 

treatment  group  was  given  one  positive  ocmnnent  related  to  competence  after 

eadi  practice.    A  comment  also  was  inserted  in  the  middle  of  the  third 

practice. 

The  oorannents  were 

1)  Good  job,  (Name  of  student),  you  are  doing  better  than  many  of 
the  other  students. 

2)  (Name),  you  are  getting  better  at  identifying  flow  chart 
symbols.    Keep  up  the  good  vork. 

3)  (Name),  many  students  can't  do  these  pnAleras  so.  you  are  doing 
very  well. 

4)  (Ncone),  congratulations.    You  did  better  than  nost  other 
students. 

Materials 

The  unit  on  flow  diart  s^nbols  was  adapted  for  the  oonputer  fraa  . 
materials  previously  tried  out  with  fcxirth-  through  eighth-grade  students. 
The  unit  covers  six  flow  chart  symbols  and  thefr  functions:    oval,  rectangle, 
dieniond,  parallelogram,  flowline,  and  bracket.    Ihe  unit  included 
introduction,  objectives  and  infonnation,  examples,  practice,  and  feedback  for 
eadi  symbol.    There  were  three  practice  activities,  one  after  every  two 
symbols.    Items  about  previously  learned  symbols  also  v?ere  included  in 
subsequent  practices.    For  each  item,  students  typed  a  single  letter  answer. 

The  experimenters   progranroed  the  unit  for  the  Atari  using  PILOT.  One 
diskette  was  created  for.ead;  treatment.    The  diskette  for  the  oonment 
treatment  gtxyap  included  the  unit  and  the  four  positive  ccnroents.  The 
diskette  for  the  no  oorament  treatment  group  contained  only  the  unit. 

Pre-  and  posttests  with  questionnaires  ytere  developed  to  assess  students' 
performance  and  attitudes.    Both  the.pretest  and  the  posttest  contained  items 
about  the  purpose  and  use  of  flow  chart  symbols.    The  pretest  had  seven  items 
while  the  posttest  had  ten.    The  first  questionnaire  consisted  of  six  items 
related  to  students*  attitudes  toward  the  computer  and  experiences  with  it. 
On  the  second  questiotinaire,  students  responded  to  seven  items  about  their 
perceptions  of  the  CAI  unit  and  their  qonpetence. 
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Ihe  frequency  of  subjects  selecting  the  computer  rather  than  paper  and 
pencil  as  the  median  for  the  next  flow  chart,  lesson   served  as  the  indicator 
of  continuing  notivation.     As  is  the  standard  practice  in  this  research  area, 
return  to  the  similar  activity  (in  this  case,  the  cotputeri  indicates 
continuing  notivation.    Pre-  and  posttests  measured  student  perfonnance.  The 
two  questionnaires  provided  data  on  student  interest  and  judgments  about  the 
unit  and  ocnp^ters. 

Design  and  Data  Analysis 

A  2  (odtinent)  by  2  (sex  of  subject)  oatipletely  crossed  factorial  design 
was  used.    The  frequency  of  subjects  choosing  to  return  to  a  oonputer  task  was 
with  an  analysis  of  variance.  - 

RESULTS 

Analysis  of  variance  of  the  prc^rtion  of  subjefcts  returning  to  task  by 
treatment  and  sex  of  subject  yielded  no  significant  differences.    TWenty-f ive 
of  29  boys  and  29  of  33  girls  returned  to  task.     Return  rates  were  similar 
for  subjects  in  the  oanment  (26/32)  and  no  oonroent  (28/30)  gnxps.  No 
significant  differences  occurred  by  treatment  and  sex  of  subject  for  posttest 
scores..  The  mean  score  on  the  ten- item  posttest  weis  5.6,  while  the  mean 
pretest  score  was  zero. 

Fosttest  questionnaire  responses  related  to  subjects*  interest  in  the 
tasks  and  perceptions  of  how  well  they  did  were  examined  for  their 
relationships  to  return  to  task^   Separate  analyses  of  variances  indicated 
significant  differences  for  five  items.    Ihe  frequencies  of  subjects  returning 
to  task  by  questionnaire  responses  eure  shorn  in  Table  1.    The  relationships 
between  student  attitudes  as  indicated  by  the  statistically  significant 
questionnaire  items  and  return  to  task  can  be  seen  in  the  percent  returns  in 
!Rdble  1.    As  the  response  choice  became  less  positive,  return  rates  dropped. 
Etor  these  who  selected  the  most  positive  response,  fran  94%  to  100%  of  the 
students  returned  to  task.    In  contrast,  for  the  least  positive  response,  only 
one  subject  returned  to  task  on  the  first  item  and  none  (that  is,  0%)  returned 
for  eadh  of  the  other  four  items. 
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-  Table  1 

Frequency  of  Return  by  Student  Attitude  Responses 


Posttest 

Questionnaire  Item 


Responses 


1.    I  think  I  did  ♦ 


Very 
Well 

15-0^ 
(100$) 


Veil 

32-5 
(86$) 


Badly 

6-1 
(86$) 


Very 
Badly 

1-1 

(50$) 


2.    This  lesson  was 


Very 

Interesting  Interesting 


17-1 
(94$) 


33-0 
(100$) 


Very 
Boring 

4-3 
(57$) 


Boring 

0-4 
(0$) 


3.    I  liked  learning  on 
the  computer  ** 


Very 
Much 

26-0 
(100$) 


Some 

28-3 
(90$) 


Very 
Little 

0-2 
(0$) 


,  Hot 
At  All 

0-2 
(0$) 


4.    This  lesson  was 


Too 
Easy 

4-0 
(100$) 


Easy 

30-3 
(91$) 


Hard 

20-1 
(95$) 


Too 
Hard 

0-4 
(0$) 


5.    I  vould  like  to  know 
compared  to  others  ♦* 


Always 

18-1 
(95$) 


Often 

20-2 
(91$) 


Sometimes 

16-1 
(94$) 


Never 

0-3 
(0$) 


♦  p<-03 

p<.0Q01  a 

The  two  numbers  shown  are  the  number. of  students  who  returned  and -who- did 
not  return.    For  example^  of  the  students  selecting  very  well  in  item  1 , 
15  returned  (100^)  and  0  did  not  return. 
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Examination  of  the  data  for  the  item  "I  think  I  did"  reveals  that  all 
subjects  who  thought  they  had  done  very  wen'retumed  to  the  canputer  (15/15) 
While  others  returned  at  lower  frequencies  (32/37,  6/7,  1/2).    Analysis  of 
variance  yielded  a  significant  difference,  F(3,55)  =  3.35,  p  <.03.  Also 
significantly  related  to  return  rate  were  subjects'  interest  in  the  lesson, 
F(3,55)  =  29.49,  p  <.0001  and < how  much  they  liked  learning  it  on  the  ocraputer, 
Po'sS)  =  30.38,  p  <.0001.    seventeen  of  18  subjects  who  thought  the  lesson 
was' very  interesting  and  ,all  who  tho^ht  it  interesting  (33/33)  returned  to 
the  oatputer,  while  three  of  seven  who  thought  it  boring  and  none  who  thought 
it  very  boring  returned  (0/4).    Similarly,  all  subjects  (26/26)  who  very  much 
liked  to  learn  on  the  catputer  and  28  of  31  who  liked  it  some  returned.  No 
one  who  liked  learning  on  the  catputer  very  little  or  not  at  all  returned  to 
task  (0/2,  0/3). 

subjects'  perception  of  task  difficulty  was  related  significantly  to  rate 
of  return,  F(3,58)  -  17.28,  p  <.0001.    None  of  those  who  thought  the  lesson^ 
was  too  hard  returned  (0/4).    Most  others  who  rated  it  fron  too  easy  to  hard 
returned  (4/4,  30/33,  and  20/21).    Eighteen  of  19  subjects  who  always  wanted 
to  know  how  they  did  canp«re^  to  others  returned  to  task,  while  none  returned 
who  never  wanted  to  know  how  they  cxmpared  (0/3)  .    Ihese  responses  were  found 
to  be  significantly  related  to  return,  F(3,57)  »  12.76,  p  <.0001. 

It  is  clear  fron  the  dat.  that  a  very  high  percentage  of  all  subjects  in 
the  study  returned  to  the  computer  task.    This  was  true  for  54  of  62  subjects 
or  87%.    Although  only  eight  -  ajects  did  not  return,  statistically      •  ^ 
significant  pattm«  eccun-  ^  in  the  questionnaire  response  but  not  with  the 
experimental  varieties-  c 

DISOBSION 

Ihe  present  study  was  contlucted  to  investigate  the  effects  of  positive 
cam«nts  related  to  <ca^tence  on  tt«  continuing  motivation  of  boys  and  girls 
doing  a  CAI  lesson.    Ihe  relationship  of  questionnaire  responses  to  continuing 
notivation  also  was  exmined.    Results  indicated  a  strong  relationship  between 
student  attitudes  and  return  to  task.    Significant  attitude  factors  included 
students'  perception  of  their  performance,  interest  level  of  the  task,  • 
attitude  toward  conputers,  p^«»ived         difficulty,  and  desire  to  know  how 
they  did  compared  to  others.    Data  also^^est  that  the  use  of  the  ccmputer 
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itself  may  be  a  strongly  motivational  factor.    However,  no  significant 
relationship  with  return  to  task  was  obtained  for  ocranent  and  sex  of  subject. 

That  significant  results  were  obtained  for  several  attitude  and  task 
related  variables  was  not  surprising.    One  factor  that  some  researchers  have 
found  to  be  important  in  continuing  motivation  is  a  student's  feeling  of 
conpetence  (Bogqiano  &  Ruble,  1979;  Deci,  1975;  Enzle  &  Itoss,  1978).  Student^^ 
responses  to  the  statement. "I  think  I  did. ..very  well,  etc."    can  be  f 
interpreted  as  indicatir^  perception  of  their  own  ocropetence  on  the  task.  Tl|e 
item,  "I  would  like  to  know  how  well  I  did  corapared  to  others"  also  is  relat  " 
to  perception  of  ocnpetence  and  was  found  to  be  significantly  related  to 
return.    Similarly,  task  difficulty  has  been  identified  in  several  studies  as 
an  important  factor  in  continuing  motivation  (ie.,  "this  lesson  was  too 
easy — too  hard").    In  a  graded  situation,  students  will  choose  a  task  which  is 
"not  too  hard  for  them  (Barter,  1978).    sijjiilar  results  were  obtained  in  this 
study  such  that  only  students  yfho  rated  the  task  "too  hard"  did  not  return. 
The  significant  relationship  occurring  between  interest  in  the  task  and  return 
seldom  has  been  investigate^.    Story  (Note  1),  however,  has  found  an  interest 
in  the  task  to  be  significantly  related  to  return  rate. 

Both  the  overall  return-to- task  rate  and  responses  to  the  item  "I  liked 
learning  on  the  oon^xiter"  indicated  that  the  microcomputer  itself  may  be  an 
inportant  factor  in  motivating  students  to  return  to  task.    Although  this 
study  was  not  designed  to  investigate  experimentally  the  motivational  effect 
of  the  computer,  results  indicate  that  it  may  have  been  the  major  factor.  The 
a/erall  retum-to-task  rate  of  87%  was  far  higher  than  the  50%-60%  rates  of 
other  continuing  notivation  studies  (Hughes,  1982;  Mosley,  1983).    It  seems 
likely  that  this  higher  return  rate  may  have  been  a  result  of,  in  a  large 
p9r<.:,  the  desire  to  continue  worlcing  on  the  microoonputer.    If  this  is  the  , 
^^joe,  it  is  of  particular  interest  because  relatively  little  researdi  has  been 
conducted  on  the  motivational,  value  df  the  computer,  per  se. 

Hie  lack  of  a  significant  effect  for  comments  on  return  to  task  may  have 
been  due  to  any  of  several  factors.    Other  researchers  (Danner  &  Lonky,  1981; 
Deci,  1971;  Harackiewicz,  1979)  have  found  that  increased  return  rates 
occurred  when  students  were  given  several  ccnroents  during  one  task.  Similar 
results  may  hot  have  occurred  in  this  study  because  of  the  depersonalized 
nature  of  the  computers-delivered  ooninents.    In  addition,  the  brief  nature  of  ay 
single  task  and  the  relatively  short  time  period  may  not  have  been  powerful 
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enough  to  establish  a  behavior  pattern  in  students.    While  we  like  to  thiiik^ 
cxmnents  influence  student  motivation,  a  greater  nunber  of  nore  personalizedx 
cxmnents  over  a  long^^r  period  may  be  required.    Finally,  the  overall  high  ^ 
return  rates  for  bo^  the  ocmment  cind  no  oonEtient  groups,  possibly  associated 
with  a  motivational  effect  from  use  of  the  computer,  left  little  room  for 
comments  to  have  aa.litportant  effect  on  return  rates. 

Results  of  the  present  study  suggest  certain  promising  directions  for 
further  reseaurch.   One  such  area  relates  to  use  of  the  computer  itself • 
Research  designed  to  investigate  experiroentedly  the  effects  on  continuing 
motivation  of  computer-based  tasks  as  contnisted  to  paper/pencil  tasks,  etc. , 
would  provide  needed  insight  into  the  motivational  value  of  microcomputers. 
Investigations  which  looked  at  personalized  ccmnents  over  longer  time  might  ^ 
yield  additional  information  on  effects  of  comments.    Questionnaire  data  , 
suggests  that  working  with  variables  such  as  competence,  interest  in  task,  and 
task  difficulty  levels  also  oould  result  in  useful  infonnation.  Further 
investigation  of  continuing  mptivation  with  variables  such  as  these  would 
better  enable  us  to  understand  jnethods  to  help  motivate  students  in  the 
classroom. 
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!•    Story,  N.O.  (1984).    Factors  influencing  continuing  motivation. 
Unpublished  manuscript. 
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The  pwpose  of  this  study  was  to  investigate  the  relationship 
between  auiitocy  leanmig  via  rate'incxaified  speech  and  the  learner's 
relative  degree  of  field  dependencse/ixidependenoee   Research  related  to 
the  cognitive  style  of  field  d^jenaenoe/ird^Jendenca/isuggests  that  the 
ability  of  field  independents  to  Uipose  struc±ure  upon  infornation  may 
facilitate  the  processing  of  avditory  inf conation  to  a  greabsr  degree 
than  is  possible  for  field  d^^endent  individuals  v*ien  inf omaticn  is 
presented  at  varying  rates  of  speed.    Such  research  itey  also  iitply  that 
ccnc^tual  density  is  a  more  realistic  variable  for  stud/  thaid  is 
absolute  word  rate.    2he  population  ooi:^isted  of  80  graduate  students. 
Materials  xsed  ocnsisted  of  nomal,  coipressed  and  eiqpanded  versions  of 
tie  Dwyer  Heart  script  and  the  related  evaluation  instruments.  S\±)jects 
were  assicpied^cli^^  rateT^otpciiss^  one  of  two  e3q>anded 

rates.  After  listening  to  their  respective  treatnents,  students  were 
admimstered  the  four  achievaneKbi.  tests.   Analysis  of  variance  procedures 
ard  regressicn  analysis  were  applied  to  the  data. 
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Purpose 

'  ■ 

The  piirpose  of  this  study  was  to  further  investigate  i±e  relationship 
between  aixlitory  learning  via  rate-modified  speech  and  the  learner's 
relative  degree  of  field  dependenoe/indqpendenoe.    Considerable  research 
has  investigated  the  cxarprdiensicn  of  veiiDal  itaterials  presented  by  meaiiS 
of  oortpressed  ooc  xate  ccntrolled  speech  (Duker,  1974) .    A  carprehensive 
review  of  this  research  (Olscn  and  Beny/  1982)  indicated>  however,  that 
lindted  research  har?  focused  cn  the  interaction  of  rate-ccntrolled  speech  / 
ccnprehension  and  various  learner  aptitudes  or  percepttial/cognitve  styles. 
Furthernorey  such  reseaixh  has  given  little  consideration  to  the  relation- 
ship between  content  ocnplexity  and  presentation  rates.    Such  research 
would  provide  (1)    a  means  wherdy  a  clearer  understanding  of  auditory 
infomaticn  processing  could  be  achieved  and  (2)  clarification  of  the 
relationship  between  learner  cognitive  style  and  conceptual  density. 

Rate-Modified  Speech 

— j  — "~ 

In  an  everchanging  society  with  an  increasingly  rapid  pace,  it 
beccroes  nore  iitportant  for  an  individiaal  to  acquire  knciwledge  and  informal 
ticn  in  the  most  efficient  and  esqpedient  itanner.    OMs  iitperative  is 
corpounded  by  the  fact  that  individuals  learn  at  different  rates.  Since 
tims  spent  in  instruction  is  an  ijtportant  factor  in  maximizing  instruction- 
al efficiency,  t^echnology  has  provided  various  means  of  altering  recorded 
speech  so  that  the  instructor  or  student  may  adji:ist  the  rate  of  spoken  / 
presentation  to  suit  his  needs.    This  technique  has  been  generally ^ ^ 
referred  to  as  rate  oontrolledi  speech  or  "Cotpressed  Speech/' 
Silverstone  (1974)  described  this  method  of  rate  ocntrol  as  the 
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••...r^roduction  of  an  original  recording  in  vMch  the  vjard-per-minute 
ratio  is  changed  to  a  slower  or-  faster  rate  of  speech  vdthout  elLminating 
the  pi-Ldi  or  natural  quality  of  the  voioe."   Silverstone  (1972) 
describes  this  technique  as  the  process  by  vMch  consonant  sounds  are 
maintaine:   s  in  the  original  production,  vowel  sounds  are  reduced  and 
pauses  are  eliinLnated  as  often  as  possible. 

Svibstai/cial  researdi  has  focused  on  both  intelLi  gdJbility  and  ocnpre- 
hension  of  rar^-modified  speech.    IntdlligibilLty  refers  to  the  extent 
that  one  is  able  to  repeat  information  which  was  presented  or  to  discriinLn- 
ate  what  one- has  heard.  .  Conprdiension  refers  to  the  abiUty  to  extract 
kTipwledge  or  ihfoniatian  from"  what  one  has  heard,  tasually  by  catpletLng 
an  objective  test.    Generally,  no  significant  differences  have  been 
found  between  nonnal  and  ccnpressed  modes  in  terms  of  oottprehension 
or  intelligibiLLty  at  rates  vp  to  250  words-per-minute  (Foulke,  1966, 
1967) .    Foulke  (1971)  ^suggested  that  this  inpLLes  a  working,  auditory 
processing  limit  of  275  words-per-minute. 

.   These  findings  have/ however,  been  questioned  in  studies  by  Adelson 

■  °  \ 

C1975)  and  dSIaan  (1977) .  ■  m  a  qotprdiensive  study,  Adelson  (1975) , 
utilized  hour  long  lectures  rather^'than  short  passages,  presented  as 
rates  of  175  and  275  words-per-minute  .\nie  researcher  suggested  that 
shorter  passages  sixh  as  those  ured  by  earH^  researchers  do  not  ade- 
quately  assess  a  listener's  overall  caiprdiensiai.^  Findings  of  the  study 
irxHcate  that  the  length  of  stimulus  materials  is  a  critical  factor. 
The  traditional  measures  of  intelligibility  and  ocnprishenSicn  were  . 
also  investigated  by  deHayn  (1977)  in  an  attertpt  to  determine  if  an 
individual's  self-selected,  rate  threshold  could  be  used  as  a  measiare  of  ^ 
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either  variable.    Results  indicated  that  an  individual's  relative  threshold 
is  an  extranely  reliable  indicator  of  catpressed  speech  intelligibiLLty 
but  not  of  ccitprdiensicn. 

Foulke  (1968b)  reported  that,  with  word  rates  ranging  frcm  125 . 
to  400  words  per  ndnute,  ooiprehension  was  found  to  be  adequate  until  „ 
the  word  rate  exceeded  250  words-per-minute.    As  the  word  rate  rose 
hi^er,  i±e  level  of  conprehension  decreases  in  an  inverse  prqporticn. 
FouUce  hypothesized  that  adequate  processing  tine  is"  needed  for  perception 
of  words  in  order  for  ooiprehension;. to- jooouri  If  processing  tine  is 
reduced,  a  decrease  in  caiprehensicn  results.    lost  processing  time  was 
indicated  to  iae  a  contributing  factor  in  the  level  of  caiprehensicn. 
HausfeM  (1981)  presented  strong  evidence  for  a  working  manory  processing 
limit  of  proximately  275  words-per-minute. 

Ohis  research  did  not  focus,  however,  on  the  affect  that  expanded 
speech  may  have  on  intelligibiHt/  and  caiprehensicn.    Since  a  slcwer 
rate  of  speedi  permits  increased  processing  time,  reducing  the  wcrd-per- 
minute  ratio  could  allow  the  listener  a  means  by  vMdi  auditory  infonna- 
Uon  could  be  processed  more,  fully.    Speech  expansion  is  a  teiduiique  whicfa 
has  been  applied  to  situaticns  "where  additional  processing  time  is  necessary 

enforcenent  has  found  this  use  to  be  practical  in  situaticns  viiere  a 
dispatcher  must  understand  or  ijiterpret  an  hysterical  telephone  call  or  • 
a  foreign  accent.    Ej^anded  speech  allows  the  listener  more  processing 
time  to  decipher  v*iat  was  said  (The  talk  of  the  town,  1978) . 

Idttle  empirical  research  has  focused  specifically  upon  the  use 
of  expanded  speedi  for  general  instructional  purposes.   Since  it  is 
frequently  a  goal  to  minimize  the  learning  time  necessary  for  aoquiring 
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infontation,  expai^  speech  has  not  provdded  the  irost  efficient  means 
to  attain  this  goal.    However,  if  the  infonnation  to  be  presented  is  not 
of  a  general  instructional  nature  but  rather  hi^ly  technical  or  coiplex, 
ej^janded  speech  nay  provide  ad3itional  processing  time  to  nore  effectively 
acquire  the  information.    Thus,  e3?)anded  speech  may  prove  to  be  a  more 
desirable  presentation  rate  for  particular  learning  tasks. 

-    It  should  be  noted  that  current  devices  used  for  production  of 
expanded  speech  have  no  provision  far  pitch  ccntrol.    therefore^  the 
resultant  nessages  tend  to  be  lower  in  pitch  and  somewhat  distorted. 
According  to  the  manufacturers  of  such  equiprent  (VSC  Corp.)  thiJs  distortion 
does  not  appear  to  be  deleterious  to  the  coiprehensicn  and  intelligibiUiy 
of  the  material. 
Charac±eristics  of  the  message 

Foulke  (1968a)    indicated  that  in  measuring  caiprehensicn,  there  are 
two  groups  of  factors -v^ch  must  be  taken  into  consideraticti:    (1)  organ- 
ismic  features  and  (2)    characteristics  of  the  signal..  QrganismLc  facttis 
inclide  age,  sex,  intelligence  and  previous  experience  with  the  subject. 
Characteristics  of  the  signal  are  ccnoemed  with  word  rate,  method  of 
~-canpressiOT-W  rate  of  occurrence  of  the  spe^ 

Relatively  few  researchers  have  devoted  adequate  attention  to  the 
dharacteristics  of  the  message  i^lf ..  Biis  third  area  for  ocnsideration 
includes  readability,  oonplexlty  of  information  and  the  relative  density 

of  ideas  car  cancegts. 

Substantial  research  has  focused  on  both  intelligibility  and  ocirpre-  • 

h^cn  of  time-caipressed  speech.    Generally  no  significant  differences 

have  been  found  between  normal  and  oatpressed  modes  in  terms  of  ocnpre- 
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hension  or  intelligibility  at  rates  vg  to  250  words  pet  ndnute  (Foulke, 
1966,1967).    These  finiings  have,  however,  been  questiaied  hy  9ther  studies 
that  have  examined  a3ditional  variables  that  may  influence  the  existing 
250  word  per  ndnute  threshold. 

One  methodological  prcblan  inherent  in  much  of  this  research  work  is 
that  they  used  a  variety  of  reoorded  itessages  which  did  not  take  into 
account  the  specific  learning  objectives  or  tasks  and  the  coiplexity  of 
information.    The  efficiency  index  of  Fairbanks  used  in  past  studies 
o  assumed  that  all  passages  used  were  of  equal  difficulty  and  iitportanoe. 
Factors  such  as  the  length  of  the  stimulus  materials,  density  of  ideas, 
items  learned  and  not  learner,  and  the  difficulty  of  itens  learned  and  not 
learned  were  not  considered  (Adelscn,  1975) .   Other  research  suggests 
that  regardless  of  the  speaking  rate  utilized,  increasing  the  difficulty 
of  the  stijnulus  material  results  in  a  reduction  of  the  ^amount  of  material 
that  is  corprehended  (Spicker,  1963).    Gramnatical  ocxtplexity  has  also 
been  shown  to  have  an  inverse  effect  on  the  amount  of  ootprehension  of 
coipressed  material  (Feid,  1968) .    Ohe  type  of  infoimation  used  has  an 
effect  on  cotprehension  and  may  also  r^resent  related  but  different 
aspects  of  listening  coiiarehension.    Pegardless  of , the  types  of-information, 
the  threshold  for  word  rate  may  be  Icwer"  than  vAiat  was  originally 
identified  (Rossiter,  1971) .   A  listening  threshold  has  been  found  to  be 
a  measure  of  intelligibility  but  not  catprehensicn.    Ohese  thresholds  • 
are  consideredto  be  sensitive  to  individual  differences  and  reflect  sane 
teiporal  liinit  of  infonnatdon' processing  (deHaan,  1577) .  Consequently, 

little  generalizability  frcm  these  findings  is  possible. 
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Cognitive  Style;    Field  D^iendenoeyindependencg 

Cognitive  styles  have  been  defined  by  Kogan  (1971)  as  the  iiidividual 
variation  in  nodes  of  "^rehendmg,  storing,  transforming  and  utilizing 
information."    Fagan  (1978)  further  stated  that  cognitive  styles  are 
"psychological  dimensions"  which  reflect  the  individual  differences  for 
the  manner  of  receiving,  .'processing  and  utilizing  informaticn.  Witkin, 
Moore,  Goodenou^  and  Cox  (1977)  described  the  diaracteristics  of  cogni- 
tive styles  as:    (1)  cognitive  styles  deal  with  the  "form"  rather  than 
"content"  cf  cognitive  acti-Tities,    (2)  cognitive  styles  are  generally 
considered  stable  over  time,  srA    (3)  cogrdtive  styles  are  "bi-polar" 
unlike  intelligence  or  other  psychological  variables. 

One  cognitive  style  which  has  attracted  miach  research  attention  has 
been  that  of  field  d^jendenoe/iiidepehdence,  identified,  by  Witldji,  Oltman, 
Raskin  and  Karp  (1971).    Sinplistically,  field  d^^endence/independence  has 
been  described  as  the  extent  to  vffiich  an  individual  can  disenbed  a  figure 
fran  a  ground.    OMs  perceptual  ^tude  is,  ^hcwever,  iidicative  of  a 
much  more  pervasive  cognitive  ability  which  enables  the  field  independent 
individual  to  iitpose  structure  vpcxi  perceived  informaticn  and  then  use  , 
this  structure  to  moaje  efficiently  process  and  store  the  information. 
I  ihis  perceptual  ability  has  been  docunented  extensively  by  Karp  (1963) 
and  Goodenough  (1976) .  Generally,  the  factor  of  field  dependence/ 
independence  is  neasured  by  either  the  Rdd-and-Frame  Test  or  one  of  a 
nuntaer  of  Bibedded  Figure  Ttests  (Enb^ded  Figures  Test,  ChiLarens^ 
Btbedded  Figures  Test;: Group  BiiJedaed  Figures  All  of  these 

instruments  rely  vpon  the  visual  perceptual  system  and  consequently 
have  nost  frequently  bfeen  atplqyed  in  investigati^  of  visual  learning 
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variables.    Gocx3enou^  (1976) ,  hcMever,  .suggests  the  rruch  broader 
plication  of  these  instruments. 
Orientation  of  the  Present  Study 

The  general  reraundancy  in  language,  identified  by'  Shannon  and 
Weavei:  (194'9)  suggests  great  similarities  between  the  auditory  perc^tual 
field  and  th^  visual  E^lrc^ptual  fieldl    In  listening  to  an  auditory 
message,  the  peroeiver  ntust  separate  <V  or  diseiibed  relevant  fran 
irrelevant  infonnaticn  then  furthW  restructure  this  infontaticn  for 
storage.    It  wooid  appear  then,  in  tent^  of  auditory  learning,  that  the  ^ 
factor  of  field  depssidence/independence  Wold  operate  cn  the  listener's 
ability  to  distinguish  and  organize  the  relevant  auditory  cues  and  terms. 
If  this  rationale  isindeed  accurate,  then  field  inJ^>endent  individuals 
could  be  expected  to'  demonstrate  greater  ability  in  inposing  such  a 
structure  and  hence,  shouK^om  better         field  dependent  individuals. 
When  the  rate  of  information  is  increased,  as  in  the  case  of  ooipressed  ^ 
audio  messages,  this  difference  could  be  e3?)ected  to  increase  even  further. 

According  to  Flaherty  (1979)  field  independent  learners  are  more 
c^le  than  field  dependent  learners  of  listening  for  meaning"  because 
they  can  concentrate  on  the  content  of  the  message  moreso  th^  the  rate 
of  presentaticai.    If  fie^  independent  leam^s  are  c^le  of  extracting 
more  content  fcon  a  oatpressed  presentation,  tiien  it  m^  be  concluded  tiiat 
they  are  also  capable  of  gaining  more  inf onnation  from  a  cotpressed 

presentation.  \ 

With  respect  to  expanded  speech,  little  research'  has  focused  on 
this  aspect  of  rate-modified  speech  because  thelslc*^"  rates  have  had 
little  apparent  value  in  iitproving  instructional  effectivenass.  Hcwever, 
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the  stiitulus  inaterials  vased      previous  research  efforts  have  had  little 
or  no  standardization.  .Uie  question  of  idea  or  infornation  density  has 
also  not  been  addressed  to  any  great  detail.     When  caiplex  informaUcn 
containing  a  substantial  arrount  of  detail  with  little  redundancy  is 
presented  at  a  conpressed  rate  of  speed,  the  result  cannot  be  .ponpared  vdth 
a  passage  of  less  ootplex  information  presented  at  the  sane  accelerated 
rate,    studies  in  rate-iicdified  speech  thus  far  have  inainly  concentrate 
on  the  rate  of  presentation  and  not  the  varying  anounts  of  information  or 
idea  density  presented  in  different  passages.    Perhaps  for  more  corplex 
material  that  ocntaiiis  many  items  of  inf ormatiai  a  greater  amount  of 
processing  time  is  Essential  to  process  and  understand  vAiat  is  presented 
aurally.  Tnis  m^  be  further  ocnpou«aed  by  the  real  possibility  that 
ii^viduals  who  differ  in  their  relative  degree  of  field  dependence/ 
'  independence  may  also  differ  in  their  processing  styles  or  abilities. 
Differences  in  idea  or  infonnation  density  may  also  have  an  effect  on  hew 
well  listeners  can  corprehend  the  spcken  material. 

A  second,  yet  related  factor  has  been  discussed  in  the  literature 
on  coipressed  speedi,  that  of  utilizing  reliable  and  valid  iiistruirents 
for  the  evaluation  of  listener  cotprdiensicn.    Until  the  present,  no 
standardized  instruments  have  been  developed,  and  those  vfliidi  had  been 
developed  resented  a  global  neasure  of  a  varieiy  of  learning  tasks, 
work  done  by  Hietts  (1974)  suggest  that  learning  researdi  should  also 
focus  on  the  sEtecific  learning  task  being  presented.    Sudi  a  charge 
would  iitply  that  specific  learning  tasks   presented  via  auditory  channels, 
be  evaluated  using  instruit^ts  designed  to  measure  achievement  of  each 
of  those  specific  tasks.   For  this  reason,  a  part  of  the  research,  and 
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evaluation  materials  developed  by  Dwyer  (1967,  1972)  were  enplcyed  in 
this  investigation.  ^  The  evaluation  instnments  incorparatfid  in  this 
package  allow  the  researcher  to  evaluate  learner  achievssnsnt  relative 
to  four  different  learning  tasks  or  objectives:    dravdng  or  spati^ 
restructuring  infarmation,  terminology  esc  recall  of  specific  information, 
idenafication  or  spatial  analysis  and  oonpraiension  or  interrelating 
infonnation.    In  addition,  a  total  test  measures  overaU  adiievanent  on 
all  tasks.   Ihe  use  of  such  materials  would  seem  to  represent  a  more 
precise  method  of  evaluating  achievement  ca:  oomprdiensicn*  of  information  . 

via  the  aivH  tnry  mode. 
Method 

The  stiirulus  naterials  used  in  the  study  oonsisted  of  fi3ur  audio 
t^  produoed  from  the  2000  word  instructional  script  on  the  human  heart 
develc^jed  by  Dwyer  (1967,  1972) .   Ihis  script  wag  recorded  by  a  professional 
narrator  at  an  average  rate  of  150  words  per  minute.   The  rate  was  selected 
as  the  nomal  or  control  rate  because  it  is  generally  ocnsidered  to  be 
the  average  speed  '  used  by  newcasters.   A  oonpressed  version  at  250  words 
per  minute  and  two  expanded  versions  of  120  and  90  words  per  rair^ute  were 
subsequently  produoed  by  use  of  the  Variable  Speech  C3ontrol  Modate  (VSC 
CSorparatlGn) . 

Ohe  five  achievenent  test  developed  by.  (Drawing  Test,  Tenrdnology 

*Itote:   The  term  cottprehension  as  used  in  previous  ^^f^J^^.^ 
:^;ssS^speeohXad  not  be  confused  vathrihe  termidajt^  the 
^■i.mehen3ior^t  developed  by  Dwyer.   l^e  ^rm  as  used  hy  D^  refers 
;^^fically  to  the  ability  to  "use  infonnation  to^^l^  some  o^ 
SeSSSv^ '(Dwyer  1972)  whereas,  the  general  ^  «=rftfS^^pf 
toTn^gereriized  abiaty  which  oouM  interd^^ 

learning  or  achievement. 
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Test,  IdenaficaUcn  lest,  Corprehension  Test  and  Total  Test)  to  coipliirent 
the  iiistruc±ianal  script  were  einplcyed  as  evaluation  instruments.  In 
addition,  the  Group  Errbedded  Figures  Test  developed  by  Wltidn  et  al  (1971) 
was  used  to  determine  the  relaUve  degree  of  field  dependenoe/indq?endenoe. 

Ihe  pcpulaticn  for  the  sti:d/  consisted  of  ei^ty  graduate  students. 
Care  was  taken  to  exclude  any  individuals  having  had  prior,  fontial  training 
in  itedicine,  physiology  or  anatony  as  well  as  any  subjects  trained  in 
Cardio-Pulncnary  ResiiscLtaticn  (CPR) . 

Based  upon  the  results  of  Witkin's  Group  Eftibedded  Figures  Test, 
subjects  were  randonly  assigned  to  either  the  control  (normai  rate.  150) 
or  the  experimental  (cotpressed,  250  wpn  or  e:5)anded,  120  and  90  wpn) 
groups.   This  factor  r^resents  a  continuous  variable,  ranging  fron  0  to 
18.    Exact  cutoffs  for  the  extremes  (hi^-field  ihdependent  or  Ic^fiel^ 
dependent)  are  not  clear  and  are  generally  considered  relative  to  the 
population  being  tested.    Based  upon  previous  research  conducted  on  a 
similar  population,  cutoffs  of  11  ard  15  were  established.  Subjects 
falling  at  11  or  below  ^e  coisidered  field  dependent  and  subjects 
scoring  at  15 -or  afcve  were  considered  field  independent.    To  avoid  the 
statistical  problem  associated  with  three  level  blodcing  described  hy^ 
Cronbach  and  Snow  (1977) ,  only  the  extreme  gro^s  (field  dependent/ 
field  ind^)ent3ent)  were  included  in  the  etady. 

Groips  of  four  students  (one  control  and  three  experimental)  were 
seated  at  a  four  carrel  listening  post  and  listened  to  their  respective  \ 

versions  of  the  instructional  script  throi#i  individual  head  phones. 
litmedL; ':ely  following  the  audio  presentation,  each  sub ject ,  oonpleted  the 
four  achievenent  tests. 
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Data  Analysis 

Ihe  study  involved  an  PHTL  research  design  with  tt^o  le^^els  of  the 
«5gnitive  st/le  variable  (field  dependenoe/ind^denoe)  X  fcwr  levels 
of  the  treatitent  variable  (narmal-lSO  wpm,  ccnprassed-SSU  \vpn,  ex^ndedr 

120  wpn,  expanded-90  wpm) . 

Data  collected  were  first  analyzed  via  a  two-way  analysis  of  variance 
procedure.  Subsequently,  regression  analysis  techniques  were  used  to  t«st 
for  iinifonnity  of  regression  slq?es. 

Findings      i  ^ 

iwo-^  mJJA's  were  perfonned  on  the  scores  citained  fixxn  each  of  the 
four  achiev^t  tests  as  well  as  on  the  Total  Test  scares.    The  results 
of  these  analyses  are  presented  in  table  1. 


Suimazv  of  Analysis  of  Variancse  Besults  (n«80) 

i 

Scuztae 

i 

Drawing 
Teat 

Teminolcgy 

Zdentificaticn 

Ccnnr^iensian 
Teat 

lt>tal 
Test 

P  P 

r  p 

T 

V 

r  ■  p 

F 

P 

1 

tog,  StylB 
(C) 

1.27  .263 

0.19  .662 

0.72 

.398 

0.99  .322 

0.94 

.336 

Treatnnt 
(T) 

0.77  .514 

3.54*  .OlS' 

0.69 

.562 

3.43*  .022 

2.03 

.U7.  . 

C  X  T 

1.71  7172 

0.43  .729 

0.44 

.725 

1.47  .231 

0.52 

.670 

*Si9nif  icant  at  the  .05  Isvel 


Significant  main  effects  for  treatments  were  produced  for  the 
Tterndnology  and  Catprehensicn  tests.    J^Ucation  of  the  Scheffe  procedure 
for  pair-wise  ocnpariscns  ii^cated  that  the  nomal  (150,v)Exn)  grcxsp  was. 
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ail  both  cases,  svperior  to  the  expax-^  (90  wpm),  grcup.   No  interac±ion 
or  other  niain  effects  were  fcund  to  be  significant.  .  r^* 

Regrespicn  'analyses  were  used  to  determine  if  relatiansW.ps  existed 
between  the  cognitive  styles  of  the  subjects  and  their  scores  on  the 
achieveitent  tests.    Table  2  shows  the  results  of  these  analyses. 

Table  2 

♦  •  ■ 

Analysis  of  Variance  of  Regression  Coefficients  for 
Differences  in  Intercept  and  Slopes  between 

Cognitive  Styles  and  Treatrients  for  Adiievenent  Scores 

cn  each  Test '   .  


r2 


Drawing  Test 

1.07 

 c  

0.390 

0.026 

Terminology  Test 

2.12 

0.061 

0.005 

Identificaticn  Test 

0.57 

0.748 

0.005 

Corprdiensicn  Itest 

1.91 

0.090 

0.007 

Total  Test  ' 

1.23 

0.302 

0.013 

•   Results   of  these  artalyses  showed  the  interactioi  of  the  slopes 
to  be' ncrt:  significantly  different.    The  cognitive  style  of  .  the  si*>3ects 
e:5,laiiied  cnly.2.6,  ^,  .5,. ,7  and  1.3  percent  of  the  variance  respec- 
tively, making  the  variable  a  poor  predictor  of  adiievenent  on  the  tests. 
Discussion  and  Conclvisions 

Results  ^bierally  indicated  that  the  normal  rate  groups  scored 
higher  than  all  othef  treatirents,  hcwever,  to  a  significant  extent 
only  in  the  cotpidsoiis  of  the  nonial-lSO  wp^^ 

for  the  Oterminology  and  Corprdiensicn  Tests.    It  would  ^=pear,  that  in 
nost  cases,  riieither  the  cortpressed  or  expanded-120  wpn  versions  resultai 
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in  significanly  inproved  achievement.    Ihe  mly  group  \^ch  achieved 
significantly  less  was  tije  grap  which  experienced  the  greatest  degree 
of  ejcpansicn.    Such  a  finding  would  sean  to  directly  contradict 
Bie  sugessticn  nade  earUer  in  this  paper,  that  cotplex  informaticn, 
when  given  slower  presentation  rates,  should  result  in  improved  achieve-, 
iient.    This  was  cbviously  not  the  case,  but  these  findings  ma/  be  mare 
directly  attributable  to  two  extraneous  factors  whidi  are  effects  of 
the  expansion  process  itself  rather  than  due  to  the  actual  rate  6f 

e^^ansicn.    Ihese  factors  include  (1)    Ustener  bocedoa  and  fatigue..  . 
and  (2)    pitdi  distcartion  due  to  the  slewed  rate.    Uie  first  of  these^  ^ 
was  observed  frequently  anong  subD«±s  receiving  the  e^anded  version,  / 
and  particularly  the  90  wpn  version.   ^^^Jarently  the  slxii^  presaitaticn  / 
of  the  hic^ly  technical  infarmation  induced  a  degree  of  boredon  resulting 
in  loss  of  attention  and  concentration,   Uie  second  factte,  that  of  itessage 
distoa±ion  was  readily  apparent,  both  during  the  e^qperianent  as  veil  as 
being  cited  by  sxibjects  after  they  conpleted  the  project.   No  provision  - 
is  nade  in  the  design  of  the  speech  oar5a:essian/e:q)ansion  nodule  to  ; 
correct  the  pitch  distortion  caused  by  slxwing  down  the  t^,  such  as 
is  done  during  speeA  ccnpressic«.    At  sUght  rates  of  GJ?)ansion,  thi^ 
distortion  nay  not'be  a  significant  factor,  but  when  ej«>ansion  is  carried 
out  to  the  degree  used  in  this  study  (90  wpttO ,  extrane  distortion  occurs 
ther^  affecting  the  intelligibility  of  the  nessage  as  well  as 

cxxtprdiension.  .  ^ 

Ihe  variable  of  field  dependence  did  not  relate  significantly  to 

individuals'  corprehension  of  naterial  presented  at  different  rates  . 
sudi.as  ^^  found  by  Olson  and  Berry  (1983) .   Although  results  were  net 


statistically  significant,  field  d^oaSir^tibjects-gen^^J^^ 
on  the  expanded,  versions  than  did  field  i«3^)endent  listeners-.    In  addition, 
the  norroal  speed  groip  danonstrated  the  saite  reversal  of  itean  scores 
(field  d^jeiidents  scoring  hi^er  than  field  independent) .  which  was  ^ 
deserved  by  Olson  a«a  Berry .  (1983) .    Such'  a  finding,  agaiii  while  not  of 
statistically  significant  magnitu3e,  should  be  further  investigated.  This 
reversal  in^  svggest  that  field  dependent  individuals,  when  presented 
with  a  itora  glcbal  or  spatial  task  such  as  'required  by  the  Drarnig  'ifest,  " 
tend  to  daronstrate  hi^er  achievercEnt  and  surpass  their  field  iiuaependent 
counterparts,    it  should  be  ratettbered  hcwever,' lhat  this  effect  ^ 
observed  only  on  the  nontal  presentation  rate  gra?). 

-me  findings  of  this  study  strongly  suggest  that  furtiier  research 
be  conducted  to  oanfinn^i:or  disoonfirm  the  hypothesis  that  itore  ccnplBX 
or  technical  information  requires  a  slxwer  presentation  rate  to  facilitate 
optiiitum  adhievenent.    Research  should  further  focus  on  iHe  question  of  ■ 
intelligibility  and  listener  boredon  as  they  relate   to  learning  fron  • 
expanded  materials,    -technical  carr«±ion  of  the  pitch  distortion 
associa^J  with  expanded  spe^  should  be  investigated. 

It  is  also=apparent  that  conclusive  proof  has  not  been  presented 
regarding  tiie  instructional  effectiveness  of  auditory  materials  presented 
at  varying  rates  of  ccxt^xression  aid  expansioi  to  individuals  who  differ  in 

their  relative  decree  of  field  deperidenqe.  ^  .  

Simlarly,  researdi  should  further  investigate  thie  factors  as  they 
relate  to  the  effectiveness    or  rat£.^fied  instrri^an  presented  via  , 
both  auditory  and  visual  modes  siinultaneously. 
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Abstract 


This  paper  introduces  the  symposium,   Cognitive  Style  and 
Microcrocomputers:     A  Review  and  Synthesis  of  Current  and  Needed 
Research  and  Development.      It  presents  issues  attendant  to  research 
and  development  in  cognitive  styles  and  microcomputer  uses  wi'^hin  the 
contejct  of  instructional   technology.     The  paper  discusses  issues  o-f 
relationship  of  cognitve  style  to  learners'   general   ability  anc^  prior 
learning.      In  discussing  needs  for  research  in  and  on  microcomputers 
in  education,   the  paper  discusses  the  heritage  of  programmed 
instruction  and  teaching  machine  research  of  the  1950 's  and   1960 's,  as 
that  work  relates  to  currently  available  practitioner's  tools  in 
instructional   design  and  development.     A  plea  is  made  for  increased 
basic  research  on  learner  characteristics  and  instructinal  media 
attributes  of  currently  available  high  technology. 
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CONCEPTUAL  TOOOLS  FOR  R  8c  D  ON  APPLICATIONS  OF 
MICROCOMPUTERS  JO  INDIVIDUALIZATION 
INTRODUCTION  ' 

This  symposium  As  about  research  and  development  in 
microcomputers  and  cognitive  styles.     A  substantial  amount  of  research 
has  been  conducted  regarding  individual  .differences  in  receiving  and 
processing  information,   generally  referred  to  as  "cognitive  styles" 
(such  as  field  independence  -  dependence,   leveling  -  sharpening,  and 
impulsivity  -  ref lecti vi ty> -     On  the  other  hand,   little  research  is 
available  regarding  how  the  unique, attributes  of  computers  may  be  used 
to  adjust  instruction  to  accomodate  individual   differences,  including 
cognitive  styles.     Particularly  missing  is  resear- on  mi  crocompter  s 
in  instruction  from  a  theoretical  ly^  grounded  frame^v»crk>     The  syniposium 
will  clarif'y  major  research  issues  attending  th;c:?;.^^  tau>  :s  within 
theoretical   frameworks  provided  by  cognitive  styietis.      ;  he  sympofiium 
will  provide  information  on  current  work  and  work  iv-^ir;.  needs  to  be  - 

i 

done.  The  symposium  consists  of  four  papers:  ;»  conceptual  tool s ,  "o... 
instructional   design,   3.   measurement  ,  and  4.   instr ttctional  managem  ^'»t  . 

The  firs>t  presentati on ,   Conceptual  TodIs,   is  my  own.  That/ 
presentation  will   be  a  general  essay  on  the  topic  at  hand  and  should 
serv>^r  as  orientation  for  the  three  papers  to  fellow.     Patriciu'  Smith 
will  discuss  instructional   design  issues,  Robert  Burroway  will  d>scuss 
mea?:.arem€2nt  pctenti^as,   and  Barbara  McCqmbs  will   discuss  instructional 
manrxgement  icssuas.     Qur  di  scu.«»sants  tojplay  are  Perrin  ParkhL-rst  and 
Williv^m  Winn.     Dr.   Ron  Bur  kett ,  original  ly  to  be  a  discussi'nt,  was 
unabl6.»  to  attend  and  BiM   Winn  has  graciously  agreed  to  bo  -x 
discussant  In  his  pli^rre- 

As  a  review  n.f  this  overview,   I  want  to  restate:     our  topic  here 
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is  the  existing  and  needed  research  and  development,  in  an  area  o-f 
interest  created  by  the  combination  o-f  cognitive  s^-cyle  and 
microcomputers.     After  my  "Conceptual  Tools"  presentation,  we  will 
take  three  slices  through  this  topic.     We  will   look  at  it  in  terms  of 
instructional   design,  measurement,   and  instructional  management. 
COGNITIVE  STYLES 

You  never  know  what  a  person  is  going  to  be-  talking  about  when  he 
says  he  is  going  to  talk  about   "cognitive  styles."     He  axght  have  in 
mind  the  "educational   cognitive  style"  or  "cocni  c  1 -/e  ^tyle  mapping"  of 
Joe  Hill   or  of  Kenneth  and  Rita  Dunn's  work  in  this  area.     Or  he  might 
be  talking  about  only  the  work  begun  by  Herman  Witkiii  and  his 
associates  dn  field  independence/  dependence.     Or  he  might  be  talking 
about. a  variety  of  non-academic  learner  di ■^f er^'nces  in  perception  and 
information  processing,   as  we  will.     The-^e  include  not  only  field 
independence/  dependencfe,   but  also  such  things  as  leveling/ 
sharpening,   impulsivity/  reflectivity,   visual/  haptic,  ; 
,  distractibility,   breadth  of  categorization,   scanning,   tolerance  for 
unrealistic  experiences,   cognitive  complexity/  simplicity,  and 
conceptualising  styles,   to  name  ten.     We,   in  this  symposium,   will  be 

 -i::3llci-ng  Vi-'nari'  those   — . 

dimensions  of   individual   difference,  which  have  been  found  and  labled 
as  a  product  of  systematic  study  of  differences  in  the  way  people 
perceive  and  process  information. 

Another  way  in  which  people  who  talk  about  "cognitive  style" 
differ  among  one  another  is  with  regard  to  thei r   "puri ty. "  Some 
people  are  vary  pure,   probably  the  purest  being  those  who  restrict 
thei-  discussions  to  only  field   independence/  dependence.     That  is  a 
"pure"  thing  to  do  because,  first,   field  independence/  dependence  is  . 
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the  one  which  first  used  the  term  "cognitve.  style,  *'  and  second, 
because  the  other  style  dimensions  iri  my  list  of  ten  are  actually 
called  things  like  '•perceptual  style"   in  the  case  of  visual/  haptic, 
"cognitve  tempo"   in  the  case  of   i mpul si vity/  reflectivity,  and 
"cognitive  controls"   in  the  case  of   leveling/,  sharpening. 

The  least  purity,   in  my  view,   is  found  in  the  "educational 
cognitive  style"   and   "cognitive  style  mapping"  formulations.     For  al 1 
I   know,   there  may  be  something  to  educational  cognitive  style 
inventories  and  the  educational   prescriptions  derived  from  them,   but  I 
cannot  find  it.      Although  there  is  nothing  perfect  about  the  more 
"pure"   approaches  to  cogni ti ve  styl e ,   there  has  been,   to  my  knowledge, 
no  establishment  of  validity  to  the  instruments  usad  by  educational 
cogntive  style  proponents.      In  addition,   it  seems  inappropriate  and  ^ 
downright  invalid  to  dispense  free  and  easy  prescription  of  broad 
classes  of  treatments  regardless  of   learning  task,   such  as:    "Well,  you 
are  auditory  and  kinesthetic,   so  you  will   learn  best  from  listening 
and  getting  in  direct  touch  with  things."     Such  prescri pti ons  smack 
mare  of  the  reading  of  gypsy  tea  leaves  than  of  scientific  study  of 
instruction  or  of  a  technology  of  instruction. 

.        As  you  might-^be.  able  to„t_e_lA._f  r_om„th_e  _f   

quotient  and  that  of  the  participants  in  this  symposium  is  about  in 
the  middle.      In  other  words,   we  are  purer  than  some  but  not  as  pure  as 
others.     None  of  us  restrict  our  interest  to  field  independence/ 
dependence  on  the  one  hand,   and  on  the  other. hand  none  of  us  can  see 
much. value  to  the  Hill,   Dunn  and  Dunn,   and  other  formulations  of 
educational'  cogni ti ve  styl e.      In  sum,   we  do  believe  that  there  are  a 
variety  of   "non-academic"   individual   differences  which  are  real 
and  relevant  to  i nstructi onal , the^^^  development. 
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What  do  we  mean  by  "non-academic"   learner  differences?     I  use 
this  term  because  it  is  the  best  thing   I  can  think  of  to  differentiate 
between  what  I  have  in  mind  and  two  powerful'  influences  on  learning 
from*  instruction  which  are  not  what  I  have  in  mind:  general 
ability  and  prior  learning.     General   ability  and  prior  learning  are 
both  academic  learner  differences.      In  the  case  of  general  ability, 

the  factor  is  an  academic  one  because  of  the  fact  that  all   measures  of 

t 

general   ability  are  validated  in  terms  bf  prediction  of  ability  to  do 
school   work,   and  prior  knowledge  is  an  academic  vari abl e""  because  the 
prior   knowledge  of   interest  is  generally  in  or  related  to  the  desired 
learnings  at  hand.  .  ■ 

General   ability  and  prior  learning  share  one  thing  in^ common  and 
are  in  another  regard  at  opposites  to  one  another.     General  ability 
and  prior  learning  share  in  common  a  profound  influence  on  learning 
from  instruction.     On  the'  other  hand,  they  are  qual i tati vel y  di f f erent 
factors  with  regard  to  the  precision  with  which  they  can  be  described 
and  measured  and  the  precision  with  which  we  may  think  about  them.  We 
know  practically  nothing,    I  would  submit,   about  general  ability/ 
except  that  it  must  exist  and  that  it  varies.     Prior  learning,   on  the 
other  hand , ^  i s  .the-  f.qundati on^^ypon^^ w^  powerful  and  cl ear  1  y 

understood  principles  of   instructional   design  rest. 

In  the  domain  of  non— academic  learner  differences  lie  many 
factors,   among  which  cognitive  styles  represent  the  mostr-studied.  In 
papers  to  follow,   we  will   be  looking  at  and  thinking  about  exisiting 
and  needed  research  in  instructional   technology  which  includes 
cognitive  style. 

Before   I  leave  the  topic  of  cognitive  style,    I  want  to  note  that 
for  those  of  you  interested  in  an  extensive  treatment  of  cognitive 

439  ^„ 

ErIc  460 


styles  and  their  impact  on  learning  from  instruction,    I  can  make 
available  to  ybu  a  ^set  of  technical   report  reprints  -from  a  three  year 
basic  research  contract  in  this  area,   sponsored  by  the  Air  Force  Human 
Resources  Laboratory.      I  was  Principal    Investigator  of  that  project  ' 
which  includes  work  which  Ausburn  and  Ausburn  did  under  me  as  dc^ctoral 
students  at  the  University  of  Okl  ahoma ,  -  as  ,wel  1   as.  extensions  of  that 
work  by.  them,   others,'  and  myself-      The  Air  Force  has  long^ince  run 
out  of  stock  of  these  reports,   and  since  they  amount  to  over  250 
pages,    I c cannot  supply  them  for  free.     However,   if  you  are  interested 
in  receiving  them,   please  come  and  talk  with  rpe  at  the  conclusion  of 
this  session.  .      '       "  * 

MlfcROCOMPUTERSi  ^ 

In  the  1950's  and   1960's,   an  enormous  amount  of  research  and 
development  was  conducted  on  and  witb  teaching  machines  and  programmed 
instruction.     The  teaching  machines  fad  has^ passed,   but  it  left  us 
with  a  substantial   residue-    It  is  through  discussion  of  this  residue 
that   I  would  like  to  orient  our  thinking  about  instructional 
technology  research  involving  microcomputers  and  finally,   to  both 
microcomputers  and  cognitive  style- 

In  my  view,   the  lion's  share  of  our  practjjt i oner  'js 
instructional  technol^ogy,   including  ^uch  things  as  learning  task     ,  * 
analysis  and  our  models  of   instructional   design  and  devel opme(:it ,  are 
essentially  residue  from  the  research  and  devel opirient  with  teaching 
machines  and  programmed  i  nstructi  013  -     For ;  exampl  e,   the  feedback  loop 
in  all   our   I/D  models  —  in  which  we  take  i nf ormat i on  about  learner's 
performance  after  i nstructi on  and  re-inject  that  into  the  r^ystem  as 
feedback  to  improve  future  instruction  —  is  essentially  a 
generalization^  of  the  programmed  instruction  maxim  that  "thou  shalt 

440  - 


validate  thy  program. "     Instead  of  just  having  a  critical   reader,  an 
expert  in  your  fields  review  and  make  editorial   judgements  about 
whether  the  text  seems  clear  and  abo,ut  whether  or  not  learners 
should  be  able  to  learn  from  the  material,  a  procedure  which 
quickly  became  standard  practice  in  programmed'  instruction  development 
was  to  actuc^lly  try  out  the  material   with  learners  to  see  if  it  ; 
worked.     '^We  are  so  accustomed  now  to  the  idea  of  empirical  validation 
of   instructional   materials  and  so  accustomed  to  improvement  of  | 
materials  of   all   sorts  through  use  of   information  about  their 
effectiveness,  that  it  is  easy  to  forget  where  .these  ideas  came  from. 
Little  more  than  twenty  years  ago  these  wera  radical   innovations,  part 
of  the  programmed  instruction  movement. 

Programmed  instruction  represented  our  first  instance  of  thinking 
about  an  instrument  of  instruction,   rather  thpin  a  medium  or'a^id. 
The  reality  of  this  instrument,   this  thing,   that  was  supposed  to 
\  teach  somebody  something,   focused  the  minds  of  educational  developers 

'in  new  ways.     Since  an  ins'trument  is  supposed  to  teach  somethi  ng ,  all 

/ 

l^y  i  tsel  f  ,  devel  opers  realized  that  they  had  to  decide  on  and  describe 
pretty  clearly  what  that  something  was.     Such  was  the  beginning  of 

 b^hav-i-or^al -ob-jec^ti ves-i  ^Iit— is-atna-zing  tt7at  a  tool  developed  for  the 

express  purpose  of  facilitating  development  of  programmed  instruction 
materials  has  seen  sue     vjjidespread  use  oyer  such  a  long  period  of 
time. •  ^  / 

In   1967,   Arthur  Lumsdaine's  classic  review  of  research  in  our 
field  up  to  that,  tifne  appeared  in  the  first  edition  of  the  Handbook  of 
Research  on  Teaching,   edited  by  N.L-    Gage.     That  review  was  entitled 
"Instruments  and  Media  of   Instruction,"  and  in  it,   Lumsdaine  noted 
that  the  most  significant  thing  about  programmed  instruction  was  its 
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quality  of  representing  a  reproduci bl e ,   sel f-contained  instrument 
of   instruction,  and  as  such  it  offered  a  uvjiquely  powerful   handle  on 
research.     Looking  back   I  think  he  was  right.     He  was  so  / 
right,   in  fact,   that  the  i nf  1  i.ience  of  research  and  devel oc/ment  with 
programmed  instruction  continues  to  the  present  and  rema/ns  a  dominant 
influence  in  our  current  practitioner's  tools-    .When  yo/i  or   I  are 
frustrated  with  the  state  of  the  art  of   instructional  design,   when  we 
find  that  the  models  we  usie  have  a  di  stressing  number  of   "empty  boxes" 
at  critical   places,   such  as   "devise  instructional  strategy,"  what  we* 
are  essentially  frustrated  with  is  models  which  are  ex tensi gns  of  what 
was  learned  from  research  and  development  with  programmed  instruction 
and  teaching  machines.  •  This  is,    I  am  sure,   an  arguable  point  but  it 
i^  certainly  how  it  looks  to  r[)e.      If   I  am  correct,  or  even 
hal f -correct ,  no  wonder  statecOf  the  art  in   I/D  is  beginning  to  look 
awfully  old,   awfully  tired,   and  awfully  in  need  of  replacement  or 
supplantation  with  somethi ng  new ,   different,^  and  "better." 

It  is  not*  that  no  water  has  gone  under  the  research  and 
development  bridge  since  the  heyday  of  of  programmea  instruction.  We 
have  new  insights  into  cdgViition  and  human;  information  processing,  new 
intrests  in  the  study  of   instructional   media  attributes ,  learning 
strategies  employed  by  learners  themselves,   and,   in  short,   a  l^»rge 
number  of  new  questions  and  theoretic  insights.     All   the  new  . 
directi  ons  -and  good  work  over  ^he  past  twenty  yea.rs  notwi  thstandi  ng , 
it  appears  to  me  to  remain  the  case  that  if  you  are  in  a  school  or 
training  setting  and  you  want  to  do  instructional  development  with  the 
most  learning  payoff  per.  dollar  spent,   you  should  spend  your  time  and 
money  on  development  of  the  best  sihgl  e--track  instructional  materials 
that  you  can  design  and  develop.     And  although  we  know  t-hat  a  single 
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set  of  materials  can  be  themselves  adaptive  to  individual  .differences, 
it  is  on  the  very  question   "on  v^hat  bases., will   we  design  f or  "^adaptive 
qualities  in  our  materials?"  that  our  high  l^vel  designer — based 
answers  become  common  sense  at  best -and  weak  or f  ool  i  sh  at  worst. 
Operationally,   our  instructional   theory  is  the  heritage  of  what  they 
were  doing  in  the  1950's  and  1760's.     My  own  f i rst ' publ i cat i on , 
incidentally,   was  in   1761,   it  was  ^bout  teaching  machines.      Its  title 
was  "Hardware  and  Hard  Work"  and  it  essentially  outlined  a  great  deal 
of  what 'people  are  worrying  with  right  now  in  the  development  Qf 
computer  assisted  i  nstrucj:i  on  mater  i  al  s.     We  should  be,    I  submit, 
worrying  about  qualitatively  different  things... the  sorts  of  things 
represented  by  our  current  research  and  current  i nstructona]^ tool-s. 

^       .  ■          '  • 

We  do  have  today,   knowledge  and  tools  we  didn't  have  back  then. 
Among  those,  new  tools  are  increased  knowledge  of  some^ non-academic 
individual   differences  in  perceptian  and  information  processing  which, 
we  call    "cognitive  styles,"   lAnd  v^e  also  have  a  new  devtce:  the 
microcomputer.     Al though ' neither  of  these  things  are  trivial  in 
themselves,    I  ^think  it  is  fair  to  say  that  we  really  do  not  yet  know 
what  to  do  with  either  one.'     If  that  is  an  overstatement,   I  wi  1 1 
rephrase,  to:     we  don't  have  a  body  of  systematic  knowledge  lending 

n  J. 

prescriptions  to  instructional   designers  which  involves  consideration 
of  human  information  processing,   including  cognitive  styles,   or  of 
many  current  instructional   media  attributes,    including  those  of 
microcomputers.     Our  best  practitioner's  tools  in  instructional 
technology  rest  on  the  behaviorist  school   of   1 earni ng  theory  and  upon 
the  instructional   media  attributes  of  teaching  machines  and  other 
media-available  twenty  years  ago. 

I  hope  the  microcomputer  is  a  technology  which  will  stimulate 
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research  and  development  in  instructional   technology,   much  in  the  same 
way  that  teaching  machines  did  twenty  years  ago. .    I  hope 
microcomputers  -force  researchers  to  rp-e>cami.ne  -fundamental   tenants  o-f 
instructional   design  and  development.'     It  is  obvious,    I  think,   that  . 
microcomputers  are  being  put  to'trivial   uses  when  they  are  used  to 
emulAte  a  teaching  machine  or  programmed  text.     What  we  have  left, 
when  you  take  away  page-turner  applications  o-f  microcomputers,   is  a 
mi:;ed  bag  o-f  power-ful   and  trivial  uses  -for  which  our  instructional 
design  models  end  up.  more  or  less  naked.      Naked.      I   like  that 
metaphor.  ..it  seems  to  -f  i  t .  .  .  "mi  crocomputers  have  caught  us  with  our 
pants  down."     You  may  quote  me„  on  that. 

We  need,   it  seems  to  me,   two  things:     one  is  heavy,  widespread 
involvement  by  instructional  technology  researchers  into  programmatic, 
basic  research  on  and  with  high  technology,   including  microcomputers, 
and  learner  characteristics  which  interact  with  instructional, 
treatments.     This  research  will   not,   as  Pro-f.   6erlach  noted  in  an 
earlier  session,   provide  practitioners  with  answers,   certainly  not 
quickly.     But  second,   we  can  and  should  expect  to  see,   at  some  point, 
apprbpriate  and  use-ful   synthesis  o-f \^ur  more  current  knowledge.  To 
.put  it  concretely,   we  will   need  a. Robert  6agne^to  si-ft,  interepret, 
synthsise,   and  model   the  best  o-f  current  knowledge. 

I-f   we,   today^s  researchers  in  instructional   technology,   do  what 
they  did   in  the  1950 's  and   1960 's,   we  wi 1 1   begin  responding  to  the 
unique- attributes  .of  microcomputers  with  the  best  theory  available  End 
begin  to  -formul ate •  research  and  development  which  may  ultimately 
become  -far  more  signi-ficant  and  useful   to  education  and  training  than 
the ■'miichines -themselves .^tjver  were.  .  ' 

The^e  then  are  our  topics:     cognitive  styles  and  microcomputers. 
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YoLi  may  think  of  our  topics,   in  the  -final   analysis,   as  being  examples 
of  what  is  really  at  stake.     The  paper ;^  to  follow  will   take  their 
material  from  cognitive  styles  and  microcomputers;   what  the  papers 
are  about  is  much  broader.      I  expect  that,  the  symposium  will  give 
you  ideas  you  can  use  in  your  thinking  about  research  in  our  field 
and,   what   I  hope  this  paper  and  the  symposium  as  a  whole  will   do  is 
provoke  you  to  think  about  the  possible  in  new  and  different  ways. 
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Transfer  of  Learning  in  Educatioh 

Royer  (1979)  defines  transfer  of  learning  as  a  sequential^  process 
in  which  the  learning  of  one  pas^sage  facilitates  the  learning  of  a 
second  conceptually  similar  passage.    Transfer  of  learning,  thus 
defined,  has' been^cl^onstrated  to  occur  when  learners  study  two 
passages  close  in  time  and  when  the  passages  contain  similar 
terminology  for  redundant  concepts.  (Abramson,  1965;  Scandura^nd  Wells 
1967;  Merrill  and  Stolurow  1968;  Royer  and  Cable  1975;  Royer  and  Cable 
1976;  Ausubel  1978;  Mayer  1977;  Anderson,  1978;  Adams  &  Collins,  1979; 
Mayer  and  Bromage  1980).    However,  there  is  little  evidence  to  suggest 
whether  transfer  will  occur  in  situations  where  learners  do  not  read 
the  second  passage  for  several  days  or  wfeeks,  and/or  where  the  passages 
do  not  contain  the  same  terms  for  the  concepts  taught  in  both. 

According  to  Mayer  (1977)  and  , Royer  (1979),  >the  process  of 
facilitated  transfer  can  only  occur  when  the  memory  structures  gained 
from  the  first  passage  are  retrieved  from  long-term  memory  when  the 
learner  reads  the  second  passage.    While  retrieval  is_a]m ost^xertain— 
for.  contiguous  passages  (two  passages  read  close  in  time),  empirical 
results  say  little  about  retrieval  and  its  effect  on  transfer  when 
there  i  s  a  del  ay. 

Many  studies  have  measured  retention  .of  learning  on-delayed 
dependent  measures  and  have  found  that  students  are  able' to  recall 
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"and/br  recognize  some  but  not  all  of  the  information  they  evidenced 
learning  on  an  immediate  dependent  measure  (Hickert  and  Anderson,  1977; 
Mayer  and  Bromage,  19eU;  Reder  and  Anderson,  19P.0).    What  is  remembered 
seems  to  be  a  function  of  what  is  originally  learned  (i.e.,  facts 
versus  meaningful  concepts  (Ausubel ,  1978)),  how^it  is  learned  (i,e., 
conceptual  perspective  (Pi chert  and  Anderson,  1977)),  and  what  cues  are 
given  at  the  time  of  recall  (Pickert  and  Anderso?;,  1977),    All  three  of 
these  factors  influencing  delayed  recall  of  memory  structures  have 
important  implications  for  transfer  of  learning  across  two 

noncontiguous  passages.    —  : — —  ■  

But,  although  research  with  delayed  dependent  measures  shed  some 
insights  on  how  much  previously  learned  information  will  be  remembered 
when  subjects  are  expressly  asked  to  retrieve  it,  such  research  cannot 
leaa  to  c,eneral izations  concerning  how  much  a  second  passage  will 
stimulate  recall'  of  a  first  passage  read  several  days  before. 
According  to  Mayer  (1977),  the  availability  of  prior  knowledge,  as 
demonstrated  on  delayed  retention  tests,  does  not  ensure  that  the  prior 
knowledge  vnll.be  retrieved  from  long-term  memory  when  the  second 
passage  is  encountered.    There  must  be  a  triggering  mechanism 
associated  with  the  second  passage  which  identifies  what  prior 
knowledge  structures  to  retrieve  (Bransford  and  Johnson,  1973;  Royer, 
-l-979;--Rumnrrrhm7"T9BU)". 

In  my  research  during  the  past  year  I  have  examined  the  effects  of 
two  triggering  mechanisms  on  trenfer  of  learning  across  two 
noncontiguous  passages.    They  are  similar  terminology  for  shared 
concepts  and  a  brief  review  of  the  first  passage  read  immediately 
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before' the  second  passage* .  Before  summarizing  that  research,  however, 
I  will  establish  a  theoretical  bas^is  for  my  inquiry  in     c  context  of 
schema  theory . 

Contribution  of  Schema'  Theory 

Schema  theory  provides  a  comprehensive  framework  for  studyi  v  r"  ? 
effects  of  simi lari terminology  and  reviev>..  on  transfer  of  learning 
across  two  pa^^es.  Current  notions  of  sch-      theory  incorporate- 
concepts  originating  as  far  back  as  Bartlett  ('  'o  ')  and  developed 
numerous  cognitive  theorists  (Neisser,  1976;  Sh-'  ,  .976;  Rummelhart  & 
NormanT-19^8r-Rumrrielhart,  1980;  Spiro,  1980). 

According  to  Rummelhart  (1980),  a  schema  is  a  Srierarchical 
structure  interrelating  information  which  constitutes  a  known  concept 
such  as  an  "object,  situation,  event,  sequence  of  events,  action  and 
sequence  of  actions."    The  information  in  a  schema  includes  data  whichr 
specifies  (1)  the  common  attributes  of  instances- of  a  concept,  (2) 
variable  attributes  and  the  range  of  per :?,iS5ible  variations,  and  (3) 
default  values  for  missi^*:  attributes. 

Any  generic  data,  Va»  iable  range  or  default  assignment  can  be 
expressed  in  terms  of  another  schema.    In  this  way,  schemata  (plural  of 
schema)  embed  one  another.    Rummelhart  (1980)  sugaests  that  the 
'lenibeddjiig-chaMcterd^^  schemata  to  "represent 

knowledge  at  all  levels--from  ideologies  and  cultural  truths  tt 
knowledge  about»what  constitutes  an  appropriate  sentence  in  oi-r 
language,  to  knowledge'about  the  meaning  of  a  particular  word." 

ljf\  terms  of  schemata  theory,  memory  consists  primarily  of 
interconnected  and  embedded  schemata  (diSibio,  1982).    These  schem.'''la 
represent  all  ore's  generic  knowledge  about  the  world.    A  siibset  of 
them  are  retrieved,  or  activated  during  comprehension  to  allow  a  reader 
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to  interpret  incoming  semantic- information.    When  the  network  of 
retrieved  schemata  matches  the  sensory  inputs  at  all  levels  of 
abstraction,  comprehension  easily  folio*  s  (Bransford  &  Johnson,  1973; 
Shank,  1976;  Rurpmelhart,  1980).    When  the  schemata  do  not  match  a 
portion  of  the  incoming  datai  either  (1)  other  schemata  are  activated 
which  match  or  (2)  existing  schemata  are  modified,  else  (3> 
compr^ehension  breaks  down.    Without  ccmprehen^;ioh,  meaningful  verbal 
learning  cannot  occur  (Ausubel,  1978),  leaving  rote  learning  or  no 
learning  as  the  only  alternatives. 

Retrieval  of  schemata  from  memory  can  occur  somewhat  automatically 
as  .incoming  data  seek  to  be  matched  or  "instantiatcc^."  This  describes 
a  data  driven,  "bottom-up"  mode  of  retrieval  (Adams  &  Collins,  1979); 
Bottom-up  retrieval  starts  at  very  concrete  leve'  •  (wore  re :ognition) 
and  works  to  higher  levels  (construction  of  mean-^ng  of  sentences).  An\ 
alternate  mode,  conceptually  driven  or  "top-down"  retrieval,  activates 
schemata  from  an  initially  high,  conceptual  level  l)  provj^^essively 
lower  levels  in  anticipation  of  incoming  data  (Adams  &  Col'iins,  1979; 
Runnelhart,  1980).    Top-down  retrieval  searches  for  sco.fimota  which  will 
allow  anticipated  semantic  information  to  be  understood  upon  arrival* 

Both  bottom-up  and  top-down  processes  contribute  to  transfer  of 
learning  of  across  passages  they  influence  what  Sjchemata  related  to  a  ^ 
first  passage  are  retrieved  from  long-term  memory  to  guid?:-  the  learning, 
of  the  second  passage.    More  specifically,  bottom-up  processes  can 
influence  transfer  by  triggering  the  retrieval  'of  available  word-level 
schemata  acquired  from  the  first  passage  which  match  key  words  and 
phrases  read  in  the  second.  From  the  word-level  schemata,  retrieval 

spreads  upwards  to  more,  complex  sch.^mata.    Consequently,  when  similar 
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terminology  is  used  across  two. passages,  bottom-up  processes  can  more 
easily  target  the  relevant  schemata  from  the  first  passage  (Kintsch  et. 
dl.,  1975;  Abramson,  1965). 

Top-down  processes  facilitate  transfer  of  learning  when  two 
pa^isages  are  believed  to  conceptually  overlap.  That  is,  when  learners 
recognize  that  the  second  passage  overlaps  with  the  first,  top-down 
processes  automatically  retrieve  available  conceptual -level  schemata 
related'to  a  first  passage.  At  which  point, -retrieval  spreads  down-ward 
to  less  complex  schemata  (Adams ^&  Collins,  1979).    Students  have 
learned  from  past  experience  that  two  sequential  passages  (i.e.,  two 
chapters  from  a  textbook)  often  conceptually  overlap  and  that  the  first  . 
passage  can  provide  a  conceptual  framework  for  understanding  the 
second.    Consequently,  even  when  reading  two  contiguous  passages  f rom , » 
different  sources  (i.e.,  two  journal  articles),  they  will  tend  to 
retain  many  of  the  ideas  from  the  first  passage  in  working  memory  in 
anticipation  of  using  them  to  better  understand  the  second.  However, 
as  time  passes  between  passages,  other  ideas  rep^lace  those  from  the 
first  passage  and  top-down  processes  may  not  be  able\o  automatically 
ensure  the  availability  of  appropriate  high-level  schemata  (Royer, 
1979^). 

Summary 'of  Research  by  Author  .  . 
I  have  conducted  three  studies  thus  far  in  my  research  effort. 
The  first  two  studies  served  to  pilot  the  treatments  and  dependent 
measures  used  in  the  third  and  more  complete  experiment.  Consequently, 
while  I'll  emphasize  the  last  study  of  the  series,  the  preliminary  ones 
merit  at  least  a  brief  review.  ,  '"-^ 


Treatment  Materials, 

In  all  three  studies,  I  employed  treatment  materials  modified  from 
materials  developed  by  Mayer  and  Bromage  (1980).    They  consisted  of  two 
passages,  about  computers. •  The  first  passage  presented  concepts  about 
the  parts  and  locations  within  a  computer.    For  each  part,  the  passage 
presented  tiie  following  information:  1)  a  simple  representation  of  the 
part  and  its  relationsh^ip  to  the  other  parts;  2)  an  analogy 
illustrating  the  form  and  function  of  the  part  in  terms  of  a  familiar 
object;  and  3)  a  few  elaborations  and  details  associated  with  the  part 
and  its  operation.    Mayer  aod  Bromage  (1980)  used  the  original  form  of 
these  materials  because' they  had  found  that  students  unfamil iar,  with 
computers  lacked  knowledge  about  the  parts  of  computers,  and  as  a 
consequence  had  a  more  difficult  time  learning  a  programming  language. 
I  assumed,  therefore,  that  the  knowledge  acquired  from  this  passage 
would  serve  as  a  conceptual  framework  (Frederikson,  1975;  Ausubel , 
1978;  Mayer,  1979)  for  learning  the  second  passage  which  was  about 
programming.  .      ^  ^ 

The  second  passage  tai/ght  seven  commands  found  Mn  n^iny  programming 
languages.    The  passage  presented  six  types  of  inlormation  about  each 
command:.  1)  a  brief  statement  about  the  function  of  the  commr.nd;  2)  a 
'general  statement  {including  an  analogy)  about  the  format  of  the. 
command;  3)  i  technical  specification  of  the  format;  4)  a  general 
statement  about  what  the  command  causes  the  computer  to  do;  5)  a 
technical  list  of  the  operations  performed  by  the  command;  and  6)  an 
example  of  a  command  in  the  co  "ect  format  and  a  list  of  the  operations 
the  example  command  would  perform.    Material  in  types  1,  2  and  4  were 

considered  primary  content  while  material  in  types.  3,  5  and  6  were 

. .      .  ■  ■       .  ■ 
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The  second  passage  used  technical  terms  referring  to  parts  of  a 
computer  without  defining  those  terms.    It  referenced  operations 
performed  by  the  commands  without  describing  those  operationst  In 
effect,  I  designed  the  passage  with  t^he  assumption  that  learners  will 
have  studied  previously  the  first  passage  which  defined  the  terms  and 
clarified  the  antecedents  of  the  operations.    I  specifically  designed 
the  treatment  passage  in  this  manner  so  as  to  maximize  the  amount  of 
transfer  that  would  occur.  I  followed  the  example  set  by  Royer  and 
Cable  (1975;  1976)  of  using  concrete  analogies,  designed  to  form  a 
"bridge"  to  students'  existing  prior  knowledge  (Royer,  1979)  and 
thereby  give  meaning  to  the  technical  terms  used  abstractly  in  the 

<^ 

second  passage.    Royer  and  Cable  (1975;  1976)  observed  facilitated 
transfer  of  learning  across  two  contiguous  passages  only  when  the  first 
passage  contained  concrete,  easily  understood  information  and  the 
second  passage  contained  abstract,  hard  to  understand  information. 
Dependent  Measures  ' 

The  dependent  measures  in  all  three  studies  consisted  of  two  sets 
of  multiple  choice  questions.  One  set  consisted  of  questions  testing^ 
comprehension  of  primafy  ideas  (main  points)  and  the  other  tested 
comprehension  of  secondary  ideas  (details).  The  number  of  itmes  in  each 
set  increased  with  each  study  and  many  of  the  items  were  rewritten 
before  being  used  again.  Therefore,  the  dependent  measures  across  the 
three  experiments  were  similar  but  not  identical.  Furthermore,  the  two 
sets  were. combined  into  one  measure  of  comprehension  in  the  first 
study .  '  - 


study  I' 

Design  ••  'j . 

The  design  of  the  first  study  consisted  of  a  single  independent 
variable  with  two  levels.  The  variable  was  type  of  terminology  and  the 
two  levels  were  similar  terminology  and  dissimilar  terminology.  One 
group  received  the  two  treatment  passages  with  identical  terminology 
for  shared  concepts  (e.g.,  card  reader  ).  The  other  group  received  the 
same  passages  but  with  different  terminology  in  the  first  passage 
(e.g.,  input  tray  for  card  reader).  Both  groups  received  the  second 
passage  as  soon  as  they  had  finished  reading  t^e^first. 

The  intent  of  the  first  study  was  to  measure  the  effect  of  type  of 
terminology  on  transfer  of  learning  across  contiguous  passages.    It  was 
hypothesized  the  dissimilar  terminology  would  interfere  with  transfer. 
Subjects 

Subjects  were  21  juniors  and  seniors  from  the  same  high  school 
psychology  class.  They  were  randomly  assigned  to  treatment  conditions. 
Subjects  had  as' much  time  as  needed  although*  all  finished  within  40 
minutes. 

Results 

The  posttest  scores  were  much  lower  than  expected.  The  test  was 
difficult  and  subjects  reported  that  they  had  not  anticipated  having  so 

many  que^stions  about  "details^"    Table  1  summarizes  the  results  of  the 
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Treatment            Number  of  Mean*  Standard 

Condi  tiori            Subjects  \  Deviation 

Similar  Term.            12  7  83  2.40 

Dissimilar  Term.         9  8.10  3.30 


The  difference  between  means  is  not  significant 
(T  =  0.40.  alpha  =  0.05). 

*Total  number  of  items  Wv^s  30. 

^      Study  I:    Means  and  standard  deviation 

:  '  Table  1 

The  results  must  be  interpreted  cautiously  because  of  the 

potential  flooring  effect  of  the  test.    However,  the  insignificant 

differences  in  the  mear/s  between  the  two  treatment  groups  suggests  that 

dissimilar  terminology  was  not  debilitating  when  passages  occur  close 

in  time.  The  potential  impediment  of  dissimilar  terminology  on  bottom- 

.   up  proce^ssing  may  have  been  compensated  for  by  the  facilUating  effects 

of  c^onceptual  similarity  on  top-down  processing  and/or/by  the  ' 

additional  efforts  of  students  with  dissimilar  terminology  to  cope  with 

their  unfav,drable^  condition. 

The  results  also  indicate  two  areas  in  which  the  treatment 

materials^  and  dependent  measure  needed  improvement  before  used  in 

the  second  study  of -subsequent  research:  1)  The  test  items  needed  to  be 

improved  (m^de  ^easier);  and  2)  The  students  needed  to  be  alerted  to 

read" for  details.  ' 
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...  study  H- 

Design 

The  second  study  included  two  out  of  four  treatment  conditions 
corresponding  to  a  2x2  factorial  design.  The  independent  variables  in 
the  full  design  were  1)  type  of  terminology, across  two  passages 
(similar  and  dissimilar)  and' 2J  temporal  relationship  between  two 
passages  (contiguous  and  noncontiguous).   ,  '  ^ 


Similar 


Similarity  of 
Terminology 


Tempoi-al  Relationship 

Contiguous 

Noncontiguous, 

Study  1 

Study  2 

Study  '1 

Study  2 

Dissimilar 

/ 

i  Figure  1.  j 

'        As  can  be  seen  in  Figure  one,  my  first  study  compared  a 
contiguous-similar  group  with  a  contiguous-cii ssimilar  group.  Th^  second 
btudy  compared  a  contiguoi's-sitnilar  group  with  a  noncontiguous- 
jdi ssimilar  group.  This  study  also  included  a  control  condition  which 
included  onTy  a  second  passage  and  the  dependent  measure. 


Subsects 


;/ 


Subjects  were  65  high  school  seniors  from  three  Engjish 
composition  classes.    Their  participation  jn  the  study /was  an  assigned 
classroom  activity.    Students  assigned  to  the  similar/contiguous 
condition  received  the  two  passages  containing  similar  terminology  for 
.|ill  con;cepts  included  in  both  passage- s  and  they  re^d  one  passage 
immedfiately  after  , the  other.    Student  c*s$igned  to/the  noncontiguous- 


dissimilar  condition  received  the  same  two  passages  except  that  ,the 
terms  in  the  first  passage  for  concepts  also  taught  in  the  second 
passage  were  changed  and  that  the  students  did  not' receive  the  second 
passage  until  six  days  later. 
Results  , 

Table  1  contains  the  means  and  standard  deviations  of  the  three 
condition  groups  on  the  dependent  measure.    Planned  comparisons  using 
the  T'statistic  -revealed  several  significant  differences  between  means 
as  indicated  in  Table  2. 


Treatment 
Condition 

n 

Primary 
Mean       SD.^  . 

Secondary 
Mean  SD 

1)  Contiguous- 
Similar 

18 

6,5*  . 

3,31 

5.6+  2.61 

2)  Noncontiguous- 
Disimilar 

16 

4.80 

1.42 

/ 

;1.92, 

3.9       1.54  V 

3)  control 

11 

4.5 

5.6+  1.69 

Total  number 
of  items 

14 

3 

12 

*  Different  from  groups  2  and  3  (p  <  .OB). 
+  Different  from  group  2  (£  <  .OB)*. 

Study  H:    Means  and  Standard  Deviations. 
Table  2. 


On  the  total  test,  students  in  the  contiguous-similar  group  :SCored' 
significantly  better  than  students  in  both  the  noncontiguous-dissimilar 
treatment  and  control  conditions  (t(32)=5.24,  t_(27)=2.35,  "  . 

•  respectively).    An  intteraction  occurred  between  type  of  test  and  , 
treatment  condition.    On  the  primary  test,  students  in  the' contiguous- • 

-  similar  condition  perfcrmed  significantly  better  than  the  other  two 
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groups  (t^(32)=3.25,  U27)=2.51,  respectively),  which  groups  did  not 
differ  frojn  each  other  (t(24)=g.32).  On  the  secondary  subpart,  the 
contiguous-similar  group  and  control  group  did  not  differ  from  each 
other^and  both  groups  scored  significantly  better  than  students  in  the 
noncontiguous-dissimilar  group  {t(32)=3.46,  t(27)=3.40,  respectively). 

The  differences  between  means  from  the  contjguous-similar 
condition. and  the  noncontiguous-dissimilar  group  suggest  that 
dissimilar  terminology  combined  with  a  lack  of  temporal  contiguity 
impedes  transfer  of  learning  of  both  primary  and  secondary  content.  As 
found  in  thefirst  study,  dissimilar  terminology  might  not  have  the 
same  negative  effect  with  contiguous  passages. 

The  differences  between  means  on  the  secondary  test  of  the 
noncontiguous^dissimi^lar  and  control  groups  suggests  that  the 
unfavorable  condition  of  dissimilar  terminology  in  noncontiguous 
passages  may  actually  interfere  with  certain  kinds  of  learning. 

The -lack  of  differences  between  the  ^means  on  the  secondary  test  of 
the  contiguous-similar  and  control  conditions  suggests  that  students 

"  without  access  to  a  conceptual  framework  (i.e.,  the  knowledge  structure 
acquired^from  reading  the  first  passage  and  retained  in'^working  memory) 
may  resort  to  rote  learning  (Mayer  and  Bromage,  1980;  Mayer,  1977). 

— ^h4^--€one^4iS4^n-seams-4iistj±^     because  secondary,  factual  informat i on 
tends  to  be  more  easily  learned  by  rote  learning  than  primary,  abstract 
information  (Ausubel,  1978). 
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study  III 


Design 

The  design  of  the  third  stCidy  consisted  of  two  variables  with  two 
levels.    In  addition  to  type  of  terminology  (similar  and  dissimilar), 
there  was -position  of  a  review  of  the  first  passage  (before  or  after 
the  second  passage). 

The  review  of  the  first  passage  consisted  ,qf  one  or  two  sentences 
about  each  part  of  the  simplified  xomputer.    These  sentences  nr. ade 
reference  to  the  analogies  and  main  ideas;  but  d-id  not  restate  any 
details.   The  review  also  contained  the  diagram  used  in  the  fi'^st 
passage  representing  the  simpl if ied  computer.  . 

In  addition  to  the  four  treatment  groups  formed  by  the  2/2  design, 
I  incltJded  2  control  groups.    One  control  group  received  cpnti$i^°^s 
passages  with  similar  terminology  and  the  review  before  the  second 
passage  (best  conditions  for  tr^ansfer).    The  other  cqntrol  group 
received  only  the  second  passag^ (worst  conditions  for  transfer)- 

The  intent  of  this  study  was  to  test  six  hypothese^: 

HI:    Students  reading  noncontiguous  passages  with  similar 

terminology  wi  1 1  experience  more  transfer  than  studer^ts 
reading  the. same  passages  with  dissimilar  terminolq^y* 

H2:  .  The  effects  of  similar  or  dissimilar  terminology  wil  ^1  be 
equal  for  transfer  on  primary  and  secondary  ideas. 

H3:    Students  reading  a  review  of  primary  content  from  a  ffiJ^st 

 fiAA<Lagg_immpdiatPly  before  a  noncontiguous  second  passage  ^ 

will  experience  more  transfer  than  students  reading  tt1i6  s'ame~" 
review  after  the  second  passage. 

H4:    The  effects  on  transfer  due  to  when  students  read  a  review  of 
a  first  passage  will  be  greater  on  primary  ideas,  thai^ 
secondary  ideas. 

H5:    Students  reading  noncontiguous  passages  with  both  sirt^^^*^^'^ 
terminology  and  a  review  will  experience  greater  trai^sfer 
than  students  reading  passage  with  only  one  of  the  tv^o  . 
conditions 
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H6:  Students  reading  noncontiguous  passages  with  a  review  but 
without  similar  terminology  will  experience  more  transfer 
than  students  without  a  review. 

Results 

The  results  failed  to  support  the  hypotheses  because  (1)  there 
>rfere  no  significant  main    effects,  (2)  there  was  a  significant 

^  inteiciction  among  treatment  groups,  and  (3)  the  differences  between  the 

\  ■■>  . 

best  case  and  worst  case-  control  groups  for  comprehension  of  both 
primary  and  secondary  ideas  werersmall  and  not  .significant.    Table  3 
reports  the  means  and  standard  deviations  and  Table  4  summarizes  the 
analyses  of  variance  among  the  four  treatment  conditions. 

Primary  Ideas  Secondary  Ideas 


Similar 
terminology 

Di  ssimilar 
terminology 


Review 

Review 

Review 

Review 

before 

after 

before 

after 

9.95 

7.41 

8.25 

6.74 

2.43 

2.55 

2.78 

2.49 

(20) 

(19) 

(20) 

(19) 

8.95 

10.74 

8.14 

10.00 

8.95 

3.53 

4.16 

(21) 

(19) 

(21) 

(19) 

Contiguous 

passages 

control 

Second-only 
control 


10.91 


2.69 

(22) 


9^52 
2.96 
(21) 


8.73 

"2187 
(22) 


8.95 
3.24 

(21) 


Study  III.    Means  and  Standards  Deviations 

Table  3, 
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Primary.  Ideas  Secondary  Ideas 


Source  of 
"Variance 

df  ' 

Sums  of 
Squares 

I 

Sums  of 
Squares 

£ 

Main  Effect 

2 

24.07 

1.46 

45.88 

-  1 .96 

Terminology 

1 

21.87., 

2.04 

45.29 

3.86 

Review 

1 

2.03 

.25 

.73 

.06 

Interaction 

1 

89.48 

10.82* 

55.99 

4;77* 

Explained 

3 

113.55^^ 

4.58 

1.1.87,' 

2.89 

Residual 

75  . 

620.32 

880.01 

Total  . 

78 

733.87 

981'.  87 

*Significant  at'£  <  .05. 

Study  III.    Analysis  of  Variance 
Table  4. 


Overall,  students  performed  much  low^er  than  expected  on  the 
dependent  measure.  This  unanticipated  poor  comprehension  may  be 
attributed  to  th^  difficulty  of  the  reading  materials  and  tt^  ability  ^ 
of  the  subjects.  Because  the  study  was  focused  on  transfer  in  the 
context  of  "technical  material,"  I  intentionally  made,  the  matierials 
dense  with  both  primary  and  secondary-^content.  This  density  of 
unfamiliar,  technical  concepts  possibly  overwhelmed  the  learners  and 
caused  them  to  lose  interest  in  what  they  read.  ,  I  should  note, 
however,-  that  the  passages  are  at  an  8th  grade  reading  level  according 
to  the  Flesch  Kincaid  procedure.^  The  subjects  were  8  to  20' months 
younger  than  s^^^^ 

a  significant  factor,  ability  to  read,  reason,  and  learn  may  be 
different  between  the  two  age  groups.. 
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the  two  Wrol  groups.  Acv  the  theory  outl  ined  earlier,  the  . 

contiguous  control'group  shoul.     <     <perienced  maximum  transfer  while 
the  second-only 'control  group  sh.    c  >ot  have  experienced  any  transfer. 
Because  the  control  groups  did  not  differ  from  each  other,  I  cannot  say 
that  the  differences  among  the  treatment  groups  was  due  to  transfer. 
Clearly,  other  learning  conaitioi:^  vere  in  operation— some  of  which 
might  have  been  influenced  by  treatment  manipulations.  For  example,  the 
performance >fif  the  contiguous  control  group  may  be  attributable  to 
transfer  while  the  performance  of  the  second-only  dontrol  group  may  be 
attributable  instead  to  rote  learning  procedures  (Ausubel.  1978). 
Similarly,  the  treatment  groups  may  havebeen  differentially  influenced^ 
by  transfer -and/or  rote  learning  procedures.  The  similar-before  group 
probably  experienced  more  transfer  than  the  other  treatment  c<ux»itions 
While  the  dissimilar-after  group  probably  utilized  more  rote  learning 
procedures.  In  the  section  that  follows.  I  further  discuss  these  ^ 
tentative  conclusions  "and  provide  a  theoretical  basis  for  them. 

General  Discussion 
I  had  theorized  in  earlier  that  f amil iarity'of  technical 
terminology  and  a  single  organizing  structure  (i.e..  existing  schemata 
at  both  the  word  and  concept  levels)  were  prerequisite  .for 
comprehension,  and  transfer.  In  retrospect.  I  believe  I  made  a  couple  of 
erroneous  assumptions:  I  assumed  that  because  the  passage  had  familiar 

-  -wo  rd  s  -( e.g.,-card_and  _r  ejder )  being  used  in  a  jve  ry  tech  n  ic  al  mann  er  

(i.e..  card  reader)  that  the  terms  would  not  invoke  top-down  or  bottom- 
up  processing.  Furthermore.  I  assumed  that  because  the  passages  ^ 
integrated  the  terms  into  a  novel  conceptual  structure  (i.e..  internal 

•  ,  14^2 
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make'up  of  the  computer)  that  unless  that  structure  was  presjsnt  during 

reading,  the  process  of  comprehending ^those  terms  and -deriving  meaning 

{     "  ■ 

from  the  text  would  break  down.  While  Study  II  supported  these^ 

?  - 

assumptions.  Study  III  provided  conflicting  evidence. 

Rummelhart  and  Norman^l978)  provide  a -theoretical  explanation  of 
the  outcomes  in  Study  III.    They  suggest  that  when  adequate  schemata 
cannot  be  found  to  account  for- incoming  data  via  top-down  or  bottom-up 
processing,  then  the  passage  "can  be  understood  only  in  terms  of  a  set 
of  d'isconnected  subsituations  (f acts)--each  interpreted  in  terms  of  a 
separate  schema."  In  other  words,  many  students  probably  comprehended 
individual  terms  or  concepts  in  isolation  of  each  other  rather  than 
integrating  them  within  one  meaningful  structure.    According  to  Ausubel 
(1978)  and  others  (Mayer,  1979;  Mayer  &  Bromage,  .1980),  learners 
without  a  meaningful  structure  can,  in  the  short  term,  evidence  as  much 
learning  (by  rote  procedures)  as  can  learners  with,  meaningful 
structures.  . 

Furthermore,  evidence  from  the  second  and  third  studies  suggests 
thai  weak  organizing  schemata  can  actually  impfede  positive  transfer  and 
rote  learning.  If  learners  are  led  to  believe  that  a  comprehensivej 
unifying  structure's  available  to  better  learn  arid  integrate  new  and 
diffiQult  ideas,  the  learners  are  likely  to  forgo  retrieving  a  series 
of  disjointed  structures.  Rather,  they  will' make  the  new  structure  do 
the  best  it  can.  However,  if  that  structure  is  not  well  developed, 
(does  not  contain  solid  hooks  in  the  right  places)  then  a  decrement  in 
leaning  over  the  rote  learning  procedure  is  possible. 
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Background  and  Introduction  * 

visual  comifiuriica Lions  inundate  today's  students,  and  the  ability  to 

interpret  and  utilize  thesp 'messages  is  implortant  to  the  learning  process. 

•  *  While'educators^study  the  effect. that  commercij^l  television  and  f'ilm  has^^had 'on 

^    children,  several  national  groups  seriously  pursue  the  goal  of  creating., a  more 

technologically ^aware  and  media  literate  society,  in  an  attempt  to  nullify  the' 
\   "  ^    V  V      '  '  ■     ■  .     .  •■  ■      :  . 

perceived  negative  effects  of  viewing  teJ.evision  and  film  (Kahn,  1979,  Potter , 

1982),     The  growth  of  film  and  television  study  has  lead  to  the^  development  of  • 

both  research  and  application  of  programs  designed  to  enhance  what  many  arie  >!. 

calling  "visual  literacy".,  -  ^         ,  .  . 

"  '  '        .  '.  ■  .  '       -      •    1'       •  - "  ■ 

Sharing  many  elements  with'^media  appreciation  or  film 'criticism,  visual-  * 

literacy  has  been  variously  defined,  and  theoretical  principles'  of  visual 

literacy  are  being  developed  (Hortih,  1 980) .     Visual, literacy  is:  the  ability  to 

process  elements  and.  interpret  visual  me^ssages;  -the  ability  . to  understand  and 

apprecia teethe  content  and  purpose  of  any  image,  the-  structural  and  aesthetic 

composition  in  visual ^communication  (Esdale  and  Robinson,  1981).  An 

understanding  of  the  structural  devices  basio  to  all  television  and  films*  is  one* 

V  ft  •     .  "  » 

of  t-he  main  skills  in  acquiring  visual  literacy  (Eoster,  1«979)..   .       "  «  ■ 

"An  iLinderstanding  .of^  hdw  the  structuriil  devices  of" 

composition,  lighting,  color, 'movement,  'editing,  and  sound 

are  used  to  Influence  audience  "reactions  is  the  minimal 
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requirement  for  becoming  visualjiy  literate. 

Students  '^tio  spend  more  time  wa'tching  films  and 
television  than  they  do  treading  bq.oks  or  sitting  in  . 
classrooms  need ^o  know  that  films  and  television  are  more 

■  ,         468  '  ■        '  "{■}■   ■  : 


than  instruments        entertainment,  information,  arid  artistic 
exRression  -  they  are  powerful  media,  cap'able- of ririfluencing 
viewer's  thoughts  and  actions.    As  a  first^'step.  toward' 
becoming  visually  literate,  students  should  therefore  learn     ,    *    "  . 
to  analyze  the  structural  devices  and  production  techniques 
'   •bf  filmmaking  and  their  ability  to  af^ecf  a  viewer's 
responses."  (Foster,  1979,  ,p.l2)  . 

'    Educators  are  acknowledging  the  increasing  importance  of  including  visual 

c  ■  "         •  ■ 

•> 

literacy  or  media  competencies  an  the  basic  communications  skills  of  students. 
Many  educators  have  identified  the  need  for  visual'  literacy  and  have  suggested 
activities  to  encourage  its  development  (Potter,  1^982;  Kahn,  1982;  England,  ^ 
1982;  Foster,  1979;  Sohn,  1978;  Logan,  1977).     However,  most  curricular  f 
materials  suggest  little^  assessment  of  skiMs  which  tould  establish  base  line 
data  or  allow  for  the  assessment  of  growth.    While  visual  literacy  ha been"  * 
cleiitly  def  ined,  it  has  been  much  less  clearly  investigated.    What  .is  .the  level  ' 
of  visual  literacy  of  students?    How  can  vTsual.  literacy  be -^s^essed?  v^Can  the 
various  visual  abilities  be  differentiated?.  '  .   .  ' 

^  ,*   Only,  recently- has  one  standardized  ^assessment  of  visual  literacy  skills 
been  developed  (Turner,  1979).     Turner  reported  that  this  test  was  ^vaiidat^ed  for 
high  school-  students  and  adults.    Whilo^  curricular  materials  have  , been  developed 
to  enhance  the  viewing  skills  of  elementary  school  age  students,^  no  validated  . 

assessment  has  been  made  available  fbr  that  age  group.    The  "purpose  of  thls^  s. 

■    ■  '  -  ♦  /  ' ' 

study  was  to  rfefine  this  standardizi^  visual  literacy  assessment;  (Turner,'  1979) 

■   ^  '  ■  \  ■  ^''l^  . 

to  allow  its  utilization  with  a  younger  audience^     Through  a  pilot.use  of  this 


new  assessment,  .  the  visual  literacy  of  students  was  evaluated  t,o  obtain  -data  for 
further  developmQpt  of  both  this instrument  and  its  utilization.     Some  ^ 
naturalistic  inquiry  methods  were  also  piloted,"    .  '  .    '  \  ■  'O 


Methods        -  i  .  ^        "  • 

—  —  t 

,    ^  Participants  ' 

All  the  students  in  five-eighth  grade  speech  communication  classes  in  a 
small  town  in  Illinois  were  selected,  a  total  of  approximately  75  students. 
Parental  consent  forms  were  sent  home  and  12  students  were  either  denied 
permission  or  were  absent  days  of  the  study. 

Materials  ' 

Turner's  (1980)  instrument  was  adapte^  for  use  with-  eighth- grade  students. 
The  vocabulary  and  reading  level  were  checked  by  a  reading  specialist.  The 
instrument  was. limited  to  those  questions  dealing  with  motion  media,  in  an 
-attempt  to  both  s'horten  and  focus  the  instrument  on  television-related  items. 

A  half-hour  narrative  television  program  was  chosen  for  the  focus  of 
,  discussion  on  structional  devices  of  television,  and  the  narrative  elements  of 
'  the  program.    All  the  students  were  asked  to  list  their  five  favorite  programs. 
"M.A.S.H."  was  chosen  as  the  most  watched  and  most  popular  choice. 

'-Procedures  " 
■    The  Turner  instrument  was  refined  utilizing  a  reading  specialiW  and  a 
classroom  teacher  to-^^erve  as  a  review  panel,  checking  both  the  language  level 
and  the  content  of  all  the  items.     Ten  items  were  selected  to  represent  various 
elements  of  visual  ability.     Questions  dealing  with  student  comprehension  of  the 
narrative  elements  were  also  written  and  checked  by  the  panel.    A  group  of 
personal  questions  were  added  (sex,  viewing  habits  and  preferences,  reading 
hajbits)  to  provide  data  on  student's  viewing  and  production  of,  media.  (See 
Appendix  I) 

The  instrument  was  pilot  tested  utilizing  a  presgntation-quiz-discussion 
format  familiar  to  students  as  normal  classroom  procedures.     In  each  class,  the 
investigator  was  introduced,  explained  the  procedures,  an,d  distributed  the 
instruments.     Students  responded  first  to  the  visual  literacy  questions.  A 
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videotaped  episode  of  "Mash"  was'-shovm  on  the  school's  equipment,  and  students 
then  completed  the  questions.     The. last  questions  (32-38)  were  used  as  a  basis, 
for  discussion  which  the  investigator  lead,  audio  taping  all  activities. 
Results  ^  . 

'  The  results  of  the  pilot  testing  of  the  instrument  ar%  reflected  in  the 
post-pilot  version  attached  to  this  report  (Appendix  II).     I^  general.  Turner's 
(1980)  instrument  was  found  to  be  much  too  long,  difficult,  and  beyond  the 
abilities  of  most  eighth  grade  students.     The  questions  developed  by  the 
researcher  (//11-end)  were  too  open-ended,  and  resulted  in  extremely  general,/ 
"non-answer"  responses  which  indicated  that  students  were  not  certain  what  was 
being  asked."    Questions  which  elicited  appropriate  and  more  clear  responses  were 
retained;  others  were  eliminated  or  altered.     Teacher  researcher  observations 
were  also  incorporated  into  the  post-pilot  instrument. 

The  data  actually  collected  from  the  instrument  dealt  with  1)  the  pilot 
nature  of  instrument  development  and  2)  the  actual  responses  students  provided. 

Instrument  Pilot*  ^ 

The* standardized  test  questions  from  Turner  were  found  tcr  be  much  too 
difficult  for  the  students.     For  each  question,  almost'half  the  "students 
responded  "I  don't  know"  or  "I  don't  understand  the  questions."    Using  student 
discussion,  and  questions  and  respons^'es  from  the  instrument,  new  visual  literacy 
questions  were  developed  which  focused  on  the  production  techniques  used  to 
present  the  narrative.  " (Appendix  II) 

Questions  about  the  narrative  elements  of  plot,  setting,  characters,  and 
conflict  were  clarified  and  forced  choices  were  developed  for  some.  Some 
knowledge  of  student's  comprehension  of  narrative  elements  could  be  extrapolated 
to  their  visual  literacy  ability,  but  questions  involving  the  two  were  not 
pilot-testedl    Many  students  did  not  finish  the  instrument. 
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Student  Responses 

Students'did  not  know  the  correct  answers  to  the  Turner  instrument 
questions.    No  more  than  10%  of  those  responding  to  a. choice  selected  the 
correct  response  (number  1-10).  .  ^  . 

Personal  data  was  also  collected.    Of  the  64  students,  38  were  boys,  26 
were  girls.     They  saw  an  average  of  one-two  films  per  week  in  school,  less  than 
two  per  month  at^-^a  theater,  and  over  five  per  week  on  television.     They  almost 
all  owned  a  camera,  and  over  85%  knew  how  to  take  photographs.    Most  (75%  and 
90%)  had  no  movie  or  video  camera  at  home;  88%  did  not  know  how  ^o  use  either 
one.     Over  50%  had  studied  TV  in  school.     Reading ^habits  varied  widely;  hours 
per  week  ranged  from  0-20,  with  an  average  of  6  hours.     Over  a  third  of  the 
students  (38%)  watched  two-three  hours  per  day  of  television,  but  "15%  watched 
over  six .hours  per- day  and  20%  watched  less  than  one  hour. 

This  data  could  be  utilized  to  f orjnulate  a  .media  familiarity  profile  for 
students,  and  these  questions  were  retained.  -  ■ 

Discussion 

Much  information  was  gained  from  this  project.     The  primary  focus  of'  the 
activity  was  the  development  of  an  acceptable  instrument  to  assess  the  visual 
literacy  of  prfe-high ^school  students.     However,  the  larger  question  addressed 
the  actual  methodology  and  research  instruments  utilized  in-investigating  visual 
literacy.    While  attention  was  directed  at  the  development,  pilot-testing,  and 
refinement  of  an  assessment  instrument,-  the  results  involved- mpre  than  the 
refinement  of  the  instrument. 

The  pilot  test  of  the  assessment'  involved  employing.- participant  - 
observation  methods  of  data  collection.     The  researcher  was  directly  involved  in 
guiding  students  and  observing  their  behavior  while  testing  the  instruments 
Because  of  this  direct  involvement,  the  researcher  had  an  opportunity  tot-^         i  • 
interact^with  students,  observe  the  questions  raised,  and. observe  reaction  to 
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problems  stucj-ents  encountered  with  their  tasks.    Consequently,  while  gaining 
excellent  data  pertaining  to  the  development  of  an  assessment  instrument,  the 
researcher  also  gained  experience  with  observation  methodology  and  the  problems 
of  investigating,  or  researching  visual  *  literacy. 

Proponents  of  visual  literacy  research  have  addressed  themselves  to  some  of 
the  problems  involved  in  the  investigation. of  visual  literacy  factors.  Cochran 

i) 

(1983)  has  challenged  researchers  to  consider  several  important  factors  in 
future  research.    Among  these  was  the  idea  that  naturalistic  inquiry  methods 

c 

should  be  utilized  to  investigate  individual  meaning  derived  from  visuals.  An 
interdisciplinary  apprcfach  was  recommended,  and  research  on  topics  such  as  the 
developmental  levels  of  visual  literacy  skill  attainment  was  suggested. 

With  this  challenge  to  consider  naturalistic  inquiry  and  to  investigate 
levels  of  visual  literacy  attainment,  the  researcher  focused  not  only  on  the 
development  of  an  assessment  instrument  but  also  on  the  methods  of  collecting 
data  .which  could  accompany  and  actually  strengthen  the  utilization  of  the 
.  instrument. 

In  addition  to  the  new  instrument,  the  project  derived  much  information  on 
naturalistic  inquiry.    While  students  were  unable  to  correctly  answer  "visual 
literacy"  conceptual  questions,  they  were  very  able  to  discuss  film  and 
television  elements.    The  students  revealed,  through  class  discussion  and  the 
open-ended  questionnaire,  a  varied  understanding  of  television  production 
elements  such  as  laugh  tracks,  multiple  camera  shooting,  backdrops,  sets, 
lighting,  and  sound  effects.     They  could  also  delineate  areas  of  literary 
understanding  from  television,   including  such  ^elements  as  plot, 
characterization,  setting,  climax,  and  theme.    Overall,  students  were 
enthusiastic  and  cooperative,  and  many  were  interested  in  the  results  of  the 
investigation.    They  revealed  an  active  involvement  with  television  and  film, 
and  were  interested  in  better  understanding  the  media. 
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This  pilot  revealed  rhat  another  researcher '  s  validated  test  was 
inappropriate  to  the  task.    The  observed  discussion  revealed  a  great  deal  more 
about  student's  visual  comprehension;  the' "situation,  in  which. people  use  visual 
materials"  (Cochran  et.al.  1980)  was  rich  in  information  not  available  from  the 
"test."    While  the  instrument  had  been  validated,   it  was  not  clear  and  not 

usable..  . 

The-  richest  responses  were  verbal  and  were  recorded  for  further  study. 
Kerr  (1983)  recommended  that  guidelines  be  developed  for  the  structuring  and 
categorizing  of  a  mass  of  such  data.     Perhaps  the  categories  provided  on  the  new 
version  of  the  instrument  would  facilitate  successful  categorization  of 
interview  or  discussion  data.     Guba  (1981)  has  recommended  several  methods  to 
enhance  the  trustworthiness  and  especially  the  dependability  and  transferability 
of  data  collected  in  naturalistic  inquiry.     The  results  of  this  pilot  suggested 
that  triangulation  of  technique,  overlap  (repeated)  methods,  and  an  audit  trail 
would  all  be  possible  improvements  in  the  method  of  data  collection.  (Guba, 
1980)    Results  did  not  indicate  that  a  better  written  instrument  for  individual 
response  would  provide  all  the  data  desired. 

Experimental  methods  could'' be  used  to  investigate  some  of  the  questions 
addressed  in  this  study.    Messaris  (1^75)  has  used  one  such  design  to 
investigate  viewer's  styles  of  film  interpretation  (real  or  created)  as  they 
relate  to  the  viewer's  familiarity  with  film  study,  only  to  find  that  "a 
viewer's  past  experience  does  not  appear  to  deflect  interpretational  styles...." 
(pg.  16)     It  would  seem  that  more  work,  both  experimental  and  naturalistic 
inquiry,  is  needed.  *  « 

Summary 

In  conclusion,  the  following  tasks  were  completed:  an  instrument  was 
redeveloped  for  a  younger  audience;  the  new  version  was  pilot-tested  using  five 
classes  of  eighth  graders  at  Sycamore  Jr.  High  School;  the  instrument  was 
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further  refined  utilizing  the  teacher  and. researcher,  visual  literacy 
literature,  and  the  pilot  .data.    In  addition,  information  about  utilizing  a 
naturalistic  approach  to  investigating  .visual  literacy  was  generated . f  rom  the 
project,  and  the  possibilities  for  future  research  were  explored  and  extended. 
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Appendix  i 


VISUAL  I.ITF.I^CY  TlilST 


Try  to  answer  these  10  film/TV  questions.  If  youc^do  not  understand  the  question, 
please  write  ?  in  the  margin.  " 

1.     Depth  is  created  in  TV  by  usintj  

,  a.  straight  on  filming 

b.  off  side  angles 

c.  rear  v^iew  filming 

d.  angle  on  angle  positions 


2*    Which  of  the  following  technique's  is  not  used  to  connect  sections  o|  shoV/s 
to  create  meaning?  . 

a.  shots  are  put  together  into  scenes 

b.  use  of  cut  shots  one  after  another 

c.  sequence  of  establishing,  medium  and  short  shots 

d.  none  of  these 

!•     TracUtion  creates  rules  for  media  use.    We  -have  even  developed  a  language  of 
cartoons.     A  series  of  small  smoke  puff  circles  instead  of  a  tail  pointing  to 
the  character  indicates  ^  ■    '   • 

a.  thcvughts  "  * 

b.  dreams  • 

c.  both  a  and  b  * 

d.  swearing 

A.    How  is  the  sound  recorded  for  a  fight  on  TV? 

a.  synchronously  -  at  the  same  time  the  fight  is  recorded 

b.  dubbed  in  afterwards 

c.  I  do  not  know    "  ^ 

5.    are  colors  that  are  used  in  backgrounds.  ^ 

a.  red,  green,  blue 

b.  red,  yellow,  orange 

c.  violet,  dark  green,  blue 

d.  black,  violet,  green 

6.  Most  filming  uses  the  technique  of  basic  shot  sequence.     Tliat  sequence  is  

a.  close  up,  cut-away,  long  shot 

b.  fade  in,  close  up,  fade  out  .  * 

c.  long,  medium,  close-up    2  •  • 

d.  zoom,  close-up  fade 

7.  It  is  as  important  to  expand  as  to  compress  time  in  film.     To  do  so,  you  would 


use 


a.  cut-ins  to  specific  action 

b.  film  at  greater  speed 

c.  time  lapse  photography 

d.  both  a  and  b  ^ 
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Film  techniques  like  zoom  shots  or  Tasl   o<lil  iii);  work  best  when  

a.  not  used  too  often  »  c 

b.  varied     *  -  ^  . 

c.  the  audience  recognizes  th(>ni  - 

d.  the  audience  is  not  aware  of  them  .  „ 

e.  other  reason  ^ 

The  film  "Fiddler  on  the  Roof"  was  shot  almost  entirely  with  the  camera  lens 
covered  by  an  ordinary  nylon  stocking.    Why  would  you  not  use  this  procedure? 

a.  to  enhance  qolors  ^ 

b.  to  diminish  the  sharp  focus 

Ce     to  establish  mood  '  ^  -  . 

d.  to  make  the  film  warm  and  earthy       '  , 

e.  I  do  not  know  ^ 

Time  in  f  ilm  is  both  shortened  and  expanded,  llow  would  you  show  a  boat 
steaming  up  a  river  for  20  minutes  and  docking  if  you  wanted  to  make  it 
happen  in  a  few  minutes  of  film? 

a.  shot  of  boat,  cut-away  to  wharf  and  back  to  boat 

b.  slow  the  filming  to  speed  up  actual  action 

c.  time  lapse  f ilminjg 

d.  none  of  these  ,  - 

e.  I  do  not  know  -  ^        .        ^  ^ 
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Please  try  to  answer  cacli  question,  honestly,  to  tlie  best  of  your,. ability . 

1.  I  thoujiKt  this  show  was:  ' 
very  good         good         OK         not  very  j»ood 

2.  1  understand  this  show: 

very  well  '      well         not  very  well         not  at  all 

3.  Wheal  came  to  class,  befpre  viowinR  this  ^how,   1  felt: 

happy         fairly  happy         not  very  happy  (unhappy)  depressed 

'  '  .  '  •  - 

A.    After  watching  this  show,  I  fcJL: 

happier         the  same         less  happy         sad  depressed 
5.     Describe  each  of  the  main  characters  of  this  show— who  was  the  show  about?^ 


6.    What  was  the  plot  of  this  film?    What  happens,  briefly?    From  whose'point 
of  view  do  we  see  the  story?    Who  Is,  telling  the  story? 


7.    Where  and  when  does  this  story  take  place?    What  cT.ios  do  you  see  to  help  you' 


8.    What  was  your  favorite  part  or  scene?    Why?    What  was  your  least  favorite, 
and  why?    Describe  each  as  clearly  as  you  can. 


9.     Is  there  one  scene  that  remains  In  your  mind?    Describe  It. 


.10.    n.     What  was  .the  mood  of  this  show?"  Mow  did  the  show  make  you  feel? 

b.    'what  emotion  or  mood  do  yon  think  the  sh<.w' s  producers' .wanted  you,  the 
audience,  to  feel?    Did  Lhoy  succeed? 
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11-.     Did  you  li,ke  the  sound  track— Lho  miislr?    What  effect  did  tho.  music  have? 


12.     Did  the  characters  seem  real  to  you?    Why,  or  why  not? 


13.     Can  you  describe  anything  about  how  the  show  was^  put  together?    Were  any 
important  times  left  out?    Did  time  seem  to  move  quickly  or  slowly? 


14.     Did  anything  about  the  show  bother  you?    Did  you  1\^  the  show?    Did  it 
"work"  as  a  story  for  you? 


15.     My  age  Is 


V. 


16.     I  am  male  female 


17.  I  live:  ,  .  " 

in  town         outside  of  town         on  h  farm  * 

18.  !Iow  many  films  do  you  see  in  school,  in  all  of  your  ^classes? 

1  or  more  per  weckV       about  1-^2  a  month      >    less  than  1  a  month 

19.  How  many  films  do  you  see  outside  of  .school? 

at  any  theater,  liow  many  per  month?  less  than  1-2  3-4  ^  "  5*ov  more, 
at  home,  on  TV  per  week?      0^        1-2         3-4         5  or  more 

20.  How  much  TV  do  you  usually  view? 

less  than  1  hour  per  day  4-5  hours  per  day         ,  • 

2-3  hours  per  day  ^  U  or  mow  hours  per  day 

c  ■        -  •• 

21.  Da  you  Iiavt?  a  camera  at  home?      yos  no 

•  ■      ^           _^  . 
WliaL  kind?  

1X>  you  know  how  to  take  photographs?      yes  no 
Do  you  often  take  photographs?      yos       ^  no 

22.  Do  have  a  movie  camera  at  homo?      yes         no  - 
Do  you  often  take  movies?      yes  no 
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23.     Do  you  have  a  video  camera  at  Jiomc? 
/Do  you  kni^w  how  to  use  It? 
Do  you  often  use  it?  ' 


24. 

26. 


!Iave  ,you  sl^udicd  film  making  in  any  class?  yes  no 
which  one(s)  1  :  .  1  


llaV'C  you  studied  TV  production  in  any  class?      yes  no 

Do  you  like  watching  films  in  school?      yes    .  no 
;>Ihy?  .  . 


27..    Do  you  like  watchingv videotapes  (TV)  in  school?      yes'.  no 
\niy?  '  "  ' 


28. 

29. 

SO. 
31. 


Which  do  you  like  better?  Why? 

'  Do  you  play  video  games  at  home?      yes  no 
How  many  hours  per  week? 

Do  you  play  video  games  at  arcades?  yes  no 
How  many  hours  per  week? 


Do  you  watch  TV  at  home  with  lights  on  or  off? 

How  much  do  you  read  outside  of  school?  

Books?  -hours  per  week?    Magazines?  ^  

-  Newspapers?    hours  per  week? 

32.     How  do  you  feel  when  you  watch  TV  at  home? 


hours  per  week? 
hours  per  week. 


iJ.     Why  do  you  watch  TV? 


V,.     How  do  you 


kiibw  wlKMi  the  "cUmax"  of  a  TV  story  takes  place?    Are  there  clues? 


35..     Mow  do  you  know 


wlicn  the  funny  parts-of  a  TV  Htoyy  take  place?'  Are  there  clu6s?. 
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36.    Can  you  dcEine:    shot  - 


edit  - 


•  /  zoom  .irv:  ^« 

J  ,      pan ■  y* '  •  ■  .•'  V'  * 

*i7-.     Did  you  notice  anything  about  the  lij»htinR  in  this  show? 

38*     i\nything  else  you  would  like  to  comment  on? 

o.      *  - 

'Any  questions  ydu  would  like  to  ask?* 


If 
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(New  Version)  > 
.VISUAL  LITERACY  TEST 


Please '  try;  ;tp  answer  each  question  honestly,,  to  the  best  of  your,- ability  If*yjpu 
do  nqt:  unde^^  the  question,  please  write^  a  ?  in  the  margin.    '  '  'i"-.  ' 


not  very  good 


•  i.    1  though tr this  show*. was: 

very  gqoii.        ^ .  good  OK' 
^2.  .  1  uiWerstpod  tM  '  .  V     *  v 

very  well  .  well  ,     .  .  .  "not  very\.well  i  not  at  all 

'    "■    '  -■'  "   ;■       ■-    '  ,        .  «  -'■  r 

1.   -Whert  I  came  ta  class,  J>ef ore"  viewing  thYs;  shdw?  I  felt;:,  ^  . 

happy- -fairly^  happy         not  very  happy  (iinh^plpy)      i  depressed 

4-    My  mood  after  seeing,  the  shpw  was: 

happier '  :\     the  sarae.V      less  happy       'sad  *;'  depressed 

5.    The  main  character  .was:   .  -  ■ 

(name  choices)  V;  ;     .  ;      '  ^  :     '  - 

,         a •  *  '  .      »  ■  / 


&•    The  other  characters  were: 
(name  choices)^  ; 

.       a*  . 

■ 

.  4 

C. 

d. 
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7.    The  following  events  may  or  may  not  have  been  parts  of  the. plot  of  thi§  show. 
Place  numbers  in  tront  of  these  in  the  order  they  occured.    Cross  but  any'that 
did  not  occtir.  -    V  ^  • 


1. 

2. 
'3. 
A. 


•  5. 
6. 

8. 


9. 
10. 


8^.  This  story  (show)  took  place  in: 


a. 

'  b. 

d. 


•9.    Ohe'clue  to  sliow  this  place  was: 


a. 
.  b. 
c. 

'  d. 


10.  Is  there  oiie  scene  that  remains  in  your  mind?    Describe  it. 
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11.  What  emotion  or  mood  do  you  think  the  show's  producers  wanted  you,  the 
audience^  to  feel?      ^  ^ 

a.  . 
b. 
c« 
d. 

■    •  '  e. 

12.  Can  you  recall  music  or  sound  effects  from  the  show?    If  yes  what  effect 
did  the  music  have? 

,  Yes 

No 


13.  Did  the  characters  seem  real  to  you?  Why? 

Yes      '  NO   

14.  UTiat  color /colors  were  used  the  most: 

a. 

■ 

c. 

d.  •      •  ■ 

e.  ■  ' 

15.  My  age  is>  ' 

16..  1  am  Male       "      female  ^  . 

17.  1  live:  .  .  • 

in  town         outside  of  town         on  a  farm 
f 

18.  How  many  films  do  you  see.  in  school,  in  all  of  your  classes? 

1  or  more  per  week         about  1-2  a  month         less  than  1  a  month 

19.  How  many  films  do  you  see  outside  of  school? 

at  any  theater,  how  many  per  month?         less  than  1-2         3-4         5  or  more 

at  home,  on  TV  per  week?         0         1-2         3-4  5  or  more 

20.  How  much  TV  do  you  usually  view? 

less  than  1  hour  per  day  4-5  hours  per  day 

2-3  hours  per^  day  6  or  more  hours  a  day 

21.  Do  you  have  a  camera  at  home?  yes^  no 
What  kind?  


Do  you  know  how  to  take  photographs?  yes  no 
Do  you  often.fcake  photographs?    yes  4£  no 
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22 •  Do  you  have  a  movie  camera  at  home?    yes  no 
Do  you  .often  t^ike  movies?    yes  no 

23.  Do  you  have  a  video  camera  at  home?    yes  no 

Do  you  know  how  to  .use  it?    yes      *    no  .  ' 

Do  you  often  use  it?  -  yes         no  , 

24.  Have  you  studied  film  making  in  any    class?    yes  no 
which  one  (s)   ^  '  


J 


25.  Have  you  studied  TV  production  in  any  class?    yes       ,  no 

26.  Do  you  like  watching  films  in  school?    yes  -no 

Why?  ■  '  '  ^ 

27.  Do. you  like  watching  videotapes  (TV)  in  school?    yes         no  ^  ^, 
Why? 

Which  do  you  like  better?    Why?  . 

» 

*\ 

28.  Do  you  play  video  games  at  home?    yes        .no  . 
How  many  hours  per  week? » 

29.  So  you  play  video  gam'es  at  arcades?,    yes     -    no  . 
How  many  hours  per  week?  .  ^ 

30.  Do  you  watch  TV  at  home  with  lights  on  or  -off? 

31.  How  much  do  you  read  outside  of  school?  hours  per  week?  . 

Books?    hours  per  week?         Magazines?  ^  hours  per  week? 

Newspaper?    hours  per  week? 

32.  How  do  you  feel  when  you  watch  TV  at  home? 

33.  Why  do  you  watch. TV? 

34.  How  do  you  know  when  the  "climax"  of  a  TV  story  takes  place?    Are  there  clues? 

35.  How  do  you  know  when  the  funny  parts  of  a  TV  story  take  place?    Are  there  clues? 
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36.  Can  you  define:    shot  - 

edit  -  . 
zoom  in  - 
..pan 

37.  Did  you  notice  anything  about  the  lighting  in  this  show?  What? 

38.  Anything  else  you  would  like  to  comment  on? 

Any  questions  you  would  like^ to  ask?  ^ 
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Cognitive  Styles  Research: 
Implications   for  Instructional  Design? 

.  ■  / 


A  Paper  Presented  at  the  Annual  Convention  of  the  Association  of 
Educational  Communications   and  Technology ,   Dallas,  1984. 


Patricia  L.  Smith,  PhD 
Univer s i ty  of  Oklahoma 
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4  Abstract 

Microcomputers  have  present ed "  ins true tional  designers  with  an 
ideal   tool  with  which  to   deliver   individualized   instruction.  'With 
a  few  exceptions,   however,    the  results   of   cognitive  styles  research 
do  not  provide  sufficient   conclusions  upon  which  to  make  design 
decisions.      Critically  missing   in  many   studies   is  an  explication  of 
the  conceptual  binding   among   the  information  processing  "deficits" 
of  a  particular   style,    the  information  processing  requirements  of  a 
specific   task,    and   the  mechanism  within  an  instructional 
intervention  which  reconciles   the   two.      In  order   to   form' this 
foundation  of   research,   programmatic   research  into   a  particular 
style,    task,   or   intervention  and   qualitative  studies  which  examine 
in  depth  how  students  with  particular   styles  process  information 
areneeded. 
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Cognitive  Style  and  ID 

^  Cognitive   Styles  Research: 

Implications   for  Instructional  Design? 

Learner  analysis   is  an  integral   stage   in  most  models  of 
systematic  instructional  design.     During   this   stage,    the  designer 
Investigates  those  characteristics  of   the   target  audience  that 
should  be  considered   in   the  development   of  instruction. 
Traditionally,   prior  knowledge  of   content  has  been  the  critical 
learner   characteristic  analyzed.      In  addition,    features   such  as 
interests,   general  abilities,   and  physiological  characteristics 
have  been  given  attention.      In  some  cases,    designers  have  been  hard- 
pressed  within  the  delivery   systems  available   to   them  to 
individualize  instruction   to  accommodate  even  variations^  in  entry 
level   skills  and  knowledge.      Thfe  addition  of  yet  another  dimension 
—cognitive  style— to   consider   in  design  has   further  complicated 
the  situation; 

However,    the  advent   of   a  microcomputer   technology  makes   an  _ 
individualized  deliverr^^tem  possible".      Such  a  technology  makes 
accommodations   to  a  range  of   individual  characteristics,  including 
cognitive  styles,   feasible.     Microcomputer-based  instrucftion  can 
administer  initial  and  periodic  batteries,  of   assessments  and 
deliver  consequent  branched  adaptations   to   critical  learner 
characteristics.      Such  adaptations  might   include  variations  in 
attention  focusing  devices,    informational   chunk  sizes,   sequence  a^id 
structure  of  graphics,   and  response  time  and   types— to  name  but  a 
few.      Computer-based   instruction  has   some  .unique  attributes— high 

w      ■■  • 

level  of   interaction,   branching  capabilites,   rapid  judgment^  . 
capacity,   dynamic  text  and  illustration  potentials,   and  strategy 
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individualize  instruction.     As   in  many  other  situations,  however, 
the  mechanical   technology  has  outstripped   the  field's  knowledge 
base  with  which  to  answer   questions  regarding   its  most  effective 
use.    In   the  case  of   cognitive   styles  the   question  remains,  what 
kind   of   adaptations   to   instruction  should  be  made  for  what   types  of 
learners  under  which  circumstances? 

In   the  late  seventies   Cronbach  and   Snow   (1977)    and  Ausburn  and 
Ausburn    (1978)   pointed   out   that   research  centaitily  .had  not 
established   a  foundation  of   replicable,   generalizable  results 
regarding   interactions  between   traits,    treatments,  and, 
occasionally,    tasks.      Cronbach  and  Snow,    Shapiro    (1975),  and 
Ausburn  and  Ausburn  suggested  how  such^research  might  be  conducted 
in   the  future  in  order  4:o   obtain  more  conclusive  resul ts--results 
upon  which  design  principles  might  ultimately  be  established. 

What  has  been  the  progress   in  cognitive   styles   research  since 
the  reviews   of   the  late  seventies?     Have  research  .results  built  a 
firmer   bas^  upon  which  accommodations   to   learning   styles  may  be 
based?  ^  This  presentation  will   review  some  cognitive  style  by 
■treatment   interact ion  research   from  the  past   five  years  and  suggest 
some  alternative  methodologies  and  questions   for  future  research  in 
the  area. 

Review  of  Recent^Research 

A  review  of   the  Current_Index_to_ Journals^  and 
*    .  Dissertation  Abstracts  revealed  hundreds   of   studies  and^  articles 

regarding   cognitive  style.     Many  of   the  studies  were  examinations  of 
the  correlations  between  cognitive  style  and   other   styles,  other 
learner   characteristics,    or   performance  in  particular  subject 
areas.     Hoj^ever,   the  studies  examined  for  this  particular    .    .  ^ 
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•presentation  wfere  those  which  hypothesized  interactions  between 
instructional   tr.eatments  and   cognitive  styles.      This  review  was  by 
no  means   an   Intensive  analysis,    nor  was   if  an  exhaustive  reviewof  ^ 
all  studies   in   the  area  in   the  past   five  years.      The  purpose  of  • 
this  particular   investigation  was  merely  to  examine  which  styles 
and  treatment   variables,   particularly  those  variables   pertinent  to 
instructional  design,   are  being   investigated   and  what  results  are 
being  reported.      The  hope  was   that   the* type  of.  task  could   also  be 
identified,   but   too   often  the   learning   task  was  not   cle'ar ly 
explicated   in   the  research  reports. 

'  c 

Findings   from  a  selection   of   fifty  of   these   studies  are 
generally  inconclusive,   contradictory,   and,  occasionally, 
surprising.      However,    a  few  obser^va tions   can  be  based   upon  such  a 
review:  • 

1.  Field   independence/ f ield   dependence  appears   to  be   the  most 
commonly  examined   cognitive  style. 

2.  Some  treatment  variables   included   in  these  .studies  were 
-presence/absence  of  behavioral  objectives 
-expository/discovery  instructional  strategy 

-group /individual  pacing 
-high/low  structure 
-explict/implicit  feedback 
-ramdom/nonr andqm  sequence 

-simultaneous/ sequential  presentation  of  visuals 
-overt/covert   response  mode  •  *  . 

-advance/post/no  organizer 

-presence/ absence  of   attention  directing  cues 
-motion/still  visuals         f  . 
-normal/coriipr essed  auditory  rate 
-positive/pos tive  and  negative  examples 
-pre/post   question  ^Josition 
-photo/line  drawing   in  illustration 
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-alternative  media,   e.g.,  print/film 

3.  Twenty-six  of  tjie  fifty  studies  reported  statistically 
significant   style  by   treatment  interactions. 

4. -     Generally,   a   structured  approach--ins truct or  pacing, 
expository   js trategy--seems   to  promote  better  performance   in  field 
dependents   than  an  unstructured  approach.   '  Regression   slopes  for 
field   independents  were  much  less  steep   than  those  for  field 
dependents.      In  some  cases   int erac tt^ons  were  disordinal,  with 
independents   performing  more  poorly  \under  *a   structured  appiroach. 

5.  Most   studies  were  weak  in  jexplicating   the  specific 
^theoretical  binding   among  information  processing   traits  of 
individuals  with  particular  styles,    information  processing 
requirements   of   part^icular   tasks,   and   tVhe  accommodating  mediation 
of   the  ins truct ional  treatments.  i 

Some   studies'did,   however,   attempt  to  hypothesize  these 

interrelationships.      Four  particularly  interesting   studies  of  this 

1  -  ,  ■ 

category  are  briefly  described   in  thci  following  paragraphs, 
Exemplary  Studies 

Ausburn  and  Ausburn   (1978)   report  aj  study  in  which  Ausburn 
(1975)   examined   the  relationship  between 
processing   style,   a  task  that  required  th< 

images  for  retention,"  and  two  image  pr e^^entat ion  modes  —  sequential 
or  simultaneous.     Ausburn  found   thair^rhTle  both  styles  benefited 

more  from  the  simultaneous  mode  of  presentation,    the  regression 

~  \   .  ' 

slope  for   the  haptic  learners  was  much   steeper.      Ausburn  concluded 

\ 

\^  *■ 

that   the  simultaneous  presentation  of   images  .supplanted  haptics 


the  vi&ual/hap tic 

e  "mental  comparison  of - 
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need   to  perform  the  complex  operation  of  retaining  multiple  mental 
images.  ^  ^  . 

Satterly  and  Telfer    (197.9)   report  a  stu-dy  in  which  the 
ihterafction  between  field   independence  and   inclusion  of   an  advance 
organizer  on  verbal   information  learniiig'was   examined.  The 
organizer  variable  included   three  levels:   no  advance,  organizer , 
advance  organizer,   and   advance  organizer  plus   specific  references  t 
organizing  prpperties  of   the   organizer   throughout   the  les/Sqn. 
Finding  a  statistically   significant   interaction  between  cognitive 
style  and   treatment,    the  researcher  concluded  that  field   dependent  . 
learners   benefited  more  from   the  treatment  whi,ch  included  the 
advance  organizer  plus   specific  references  to  it   than  did  their 
Afield   independent   counterparts.     Evidently  f ield  dependent  learners 
needed  to  have   the   implications  of   the  advance  organizer  made 
explicit. 

S^iro  and  Tirre    (1980)    found   that   field   dependent  students, 
unlike   their  field   independent  peers,   were  unable   to  utilize  a 
schema. to  aid   their  recall  and  retrieval  of   information.  The 
researchers  conjectured  that   field  dependent  learners  were  unable 
to   impose  a  previously-acquired,   applicable  schema  on  a  new  form  of 
information — that   the   field-dependent^students  were  more 
"text-bound"   than   the   f ield   independent   students • 

Finally,   Konkiel    (1981)    found   that  color   cueing   aided  field 
dependent   students   to   acquire  map   skills.      The  f acilitative  . effects 
of   colbr-cueing  was  not  as   great  for   field   independent  students. 
Konkiel  concluded  that   the  color  cueing  helped   field  dependent 
students   to  disembed   critical   features   of   the  map   from  the  complex 
map  field. 
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All 'four  studi-es  are  of   interest  not   so  much  because  they 

found  statistically  significant   interactions,   but  because  they  had 

a  clear  and  specific  conception  of  a)   the  cognitive  requirements  of 

the  learning  task,^  b)    the  processing  "deficits"of   learners  at  fhe 

extremes  of  a  cognitive  styles   continuum, and  c)    the  facilitative 

mechanism  of   the  instructional  treatment.      Such  studies  have  more 

clear  implications   in  design   of  instruction   to  accommodate 

individual  learning  styles   than   studies  that  merely   "fish"  for 

interactions  with  a  very  general  treatment  and  many  measur.es  of 

cognitive  styles.      In  order   to  build  studies  with  a  sound 

conceptual  binding,   future  researchers  in  the  area  may  consider 

branching  into  alternative  methods  of  research  design. 

Sugges tions_f or_Future_Resear ch  ' 
~  "  ~" 

Clearly  the  first  branch  of   future  research  is  the 

continuation  of  experimental   studies   that   select   task,    style,  and, 

intervention  osi  clear  and  specific  hypotheses   of,  the  cognitive 

processing  involved.     Programmatic  ^xperimental  research  which  » 

intensely  examines  the  characteristics  of  a  s.pecific   style,-  task,'- 

or  intervention  would  build  up  a  core  of  research  results  that 

would  aid  future  researchers ,   and  ,*  ultimately ,   designers .  These 

researchers  may  wislx'^.to   emoloy  a  greater  variety  of  m^surement 

■  ■  "\ 

techniques  such  as  eye  movement  studies,   that  would   obtaMu  more 
precise  and  "in  process"   assessments  of  learners  mental  i 
activities. 

To  provide  information  about   the  cognitive  processing  involve 
in  task,    treatmentj   and  etyle,   some  researchers  may  wish  to 

.  '  ^         .  \ 

consider  studies  utilizing  qualitative, naturalistic  mfethods.  Such. 
studies  might   include  ,  .  ^ 
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1.  investigations  requiring  learners  at  extremes  of  a 
cognitive  style  contini:\um  to  He  introspective  and  retrospective 
while  completing,  tasks  which  require  ^complex  transf  ormat ions  of 
instructional  stimuli;         >     >        .  , 

2.  observations  of  the  manner  in  which  mas ter  .^teachers 
naturally  "adjust   thei-^' instruction  on  complex  tasks  for  students 
who  fall  at   the  extremes  of  a  particular  cognitive  style;* 

3.  analysis  of  peer   tutoring  by  students  at   the  extremes  of  a 
cognitive  styles,    identifying  how  students  with  particular  .styles  ^ 
suggest   at  tacking   specif  i<:  le darning  tasks  ;   and  -j] 

4.  studies  of   the  validity  and  feasibility*,  of  models  for 
analyzing   the  cognitive  processing  requirements  of  .learning  tasks. 

As  a  pool^of   information  is  gathered,   results  may  provide, 
s'ufficient   evidence  to  support  modifications  of   instruction  for.  ..; 
particular   types  of  learners  for  specific  types  of   tasks.     A15  this 
foundation  of  inform'ation  is  built,   there  are  some  gener^al 
questions   that   should  be  continually  considered  across  all  studies. 

I'hough  individual  studies -may  answer  specif  ic  quest  ions  ^• 
regarding   the  interactions  fo  treatmetfts*  and  styles  for  particoilar 
tasks,    in  order  for 'designers  to  be  able  to  make  us.e  of  the 

■  ■     V       \ ' 

information  some  general  questions  must  also  be  addressed: 

1.  How  do  prior> knowledge  and  general  ability  affect  the 

interactions  betw-een  cognitive  styles  and  accommodating  treatments? 

^  \  ■'*'• 

2.  Are  styles  stable  BoCross  tasks  and  content  areas? 


,  Do  essentially  perceptual.-organization  styles  generalize 

to  preposition  organizing  tasjcs? 
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4.     Is  it  ^onomicatlly  f eas;ible  to  provide'/accpmmodat i.ng 
•in^ tructio.n?5    What. is   the  cos t-benef it  rat io  of  accommodating 


^versus  nonbranching  instruction? 

5.  .  WSat  ajre'^  the  long  term  effects  of  supplanting  information 

processd-n^g  requirements  for  par.ticular  learners?     Does.  t'his\  ' 

-  \      ■  ,     /  *      ■   ^  ^  ■  -.  ■ 

accommodation ' have  long  term  deleterious  effects?  ^ 

6.  Are  'Ifearners  senstive  to  and  able  to.  take  advantag^e  ot  -  ? 

• .    ■  -     ^         •  ••  ■  ^         '      .    •  ■    .  • 

accommodations  whic4i-  are  ijicluded  in  Itis true t ion? 

7.  Are  there  in,§trupt>iqnal  delivery  •systems  which'  are  ^ 
antithetical  to  the  p ersohoiogical  dimensions  of  certain*  cognitive 

styles — e.g.,    is   CD^l  delet eri'ous   to  f ield-  dependent. -stu4ents  who* 

*  ■   .  '    '  /    ^  ,  •        '    /  - 

•       .    .        ■     .  -  v  .  .  .  ;  ..: 

may  depend  upo^  a  sacdal  'context  for.,  learndngx  ,  * 

S'ummary  :  .  .  '    '        '    'n-  '    ..-i-^^  *^        .  .  'T'^'  -  - 

'  Micro-computer s"  have"  ^fresented  instructional  designers  with  an 
ideal  tool  with  which  to   deliver  individualized  instruction.  With 
a^^ad^w  exceptions,   however,   the  b^sp.  of  cognitive  styles  research 
does  not  provide  sufficient  aLTnclusions  upon  which^to  iaake  design 
decisions.     Critically  missing  i;n  many  studies  is  an  explications  of 


the  conceptual  binding  aporig  the  Information  processing  "deficits" 
of  a  partiquiar  style,  ^the  Inf ormat loti  pxecessing  requirements  of  a 
specif ic  task,    and  the  tnechanisiii  vlthln  an  instructional 
interventlor  "-^hich  reconciles  the  two.     'In-order  to  form  this 


foundation  of  ■  research ,   programmatic  resear'ch  into  a  "p"a^ 

Style,    t2sk,\or   intervention  and  ^qualitative  studies  which  examine 

in  depth  how  students  w'ith  particular  sjtyles  process  iniortaat ion 


are  heeded. 
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Abstract 

The  effect  of  adding  time  for  processing  compressed  speech  and  the 

effects  of  questions  that  gave  adjunct  pictures  either  a  redundant 

or  a  contextual  function  were  determined.    Subjects  were  144  fourth- 

and  fifth-grade  students  assigned  randomly  to  24  groups.    They  listened 

individually  to  a  20-sentence  story  at  either  225  or  300  words  per 

minute  (wpm).    Also,  they  either  looked  at  pictures  as  they  listened 

or  only  listened.    Questions  in  cued  recall  gave  the  pictures  either 

a  redundant  or  a  contextual  function.    Alpha -was  set  at  .05.  Increase 

in  recall  was  significantly  greater  at  the  higher  than  at  the  lower 

wpm  rate  when  pause  time  was  added  between  sentences  as  well  as  when 

pictures  were  added  to  the  story.    Questions  that  made  pictures  redundant 

improved  recall,  whereas  pictures  that  made  them  contextual  did  not. 

The  results  with  respect  to  pause  time  supported  several  prior  studies. 

The  results  with  respect  to  the  use  of  redundant  pictures  suggested 

that  pictures  can  preclude  a  reduction  in  comprehension  at  higher  wpm  rates. 
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Processing  Time  and  Question  Type  in  the 
Comprehension  of  Compressed  Speech  with  Adjunct  Pictures 

Information  is  processed  primarily  by  either  listening  or  reading. 
Reading  is  often  thought  of  as  the  primary  mode  of  communication. 
However,  listening  is  also  an  important  mode.    Fumess  (1971)  agreed 
with  Early  (1971)  that  students  at  all  age  levels  spend  a  larger 
proportion  of  their  time  in  and  out  of  school  in  listening  than  in 
reading.     In  addition,  Duker  (1971)  summarized  the  results  of  several 
studies  showing  that,  "About  60%  of  the  Elementary  day  is  spent  in 
listening  of  one  sort  or  another"  (p.  103).    Listening  is  involved  in 
many  kinds  of  learning.  .  Various  kinds  of  teaching  methods  involve 
speaking  and  listening  as  the  primary  mode  of  communication— for  example, 
lectures,  discussions,  peer  learning,  certain  simulation  games,  etc. 
The  use  of  audio  materials  in  classrooms  has  increased  in  recent  years 
with  the  greater  availability  of  educational  technology,  leading  to 
even  more  emphasis  on  listening.    Moreover,  mass  communication  via 
radio  and  television  has  made  listening  more  important  to  every  person. 
Recently,  a  number  of  new  technological  developments  has  increased 
further  the  incidence  of  speech  communication.    Examples  are  talking 
calculators  and  clocks  and  special  devices  to  teach  elementary  skills 
to  children.    Pisoni  (1982)  has  been  doing  research  concerned  with  the 
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production  of  synthetic  speech  by  computers  and  anticipates  that 
such  research  will  lead  to  more  natural  communication  between 
people  and  machines. 

In  spite  of  the  importance  of  listening  in  communication, 
listening  is  ordinarily  less,  efficient  than  reading.    Whereas  in 
reading  one  can  take  in  entire  phrases  and  even  sentences  in  a  single 
glance ,^1^  listening  one  must  respond. to  single  words  in  sequence. 
As  a  consequence,  listening  proceeds  much  more  slowly  thaii  reading. 
In  reading,  people  often  "scan"  material  with  which  they  are  familiar, 
achieving  very  high  words-per-minute  rates. 

A  number  of  technological "developments  over  the  past  30. years 
has  made  listening  considerably  mor-  efficient  when  the  material 
listened  to  has  been 'tape  recorded.    The  general  term  for  the  process 
that  increases  efficiency  is  "time-coinpressed  speech."  Time-compressed 
speech—alSo  called  compressed"  speech—  was  anticipated  in  a  sense  by 
Miller  and  Licklider  (1950).    Taking  advantage  of  the  knowledge 'that 
normal  speech  is  redundant ,  that  is,  that  speech  contains  more  information 
than  is  necessary  for  its  being  understood,  they  periodically  eliminated 
portions  of  recorded  speech.    This  was  accomplished  by  having  an 
automatic  switch  turn  the  speech  of  and  off.    When  the  number  of 
interruptions  per  second  was  100,  they  f ound . that .  the  speech  was' 
understood  almost  perfectly.    Their  procedure  was  modified  by  Garvey 
(1953)  who  eliminated  small  portions  of  an  audio  tape  on  which  a  number 
of  unrelated  words  had  "been  recorded,  using  a  razor  blade,  and  spliced 
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the  remaining  portions  together.    He  had  people  listen  to  the  words 
one  at  a  time.    He  found  that  the  intelligibility  of  the  words  was  . 
unaffected  until  they  had  been  shortened  to  one-third  of  their  original 
length.    This  "chop-splice"  method  was  the  first  one  iised  for  producing 
compressed  speech.    Fairbanks,  Everitt,  and  Jaeger  (1954)  described  an 
electro-mechanical  device  that  produced  materials  very  much  like  those  . 
produced  by  Garvey,    Their  procedure  as  well  as  Garvey's  resulted  in 
speech  that  retained  the  original  voice  frequencies.    Other  such 
electro-mechanical  devices  were  produced  both  in  the  United  States  and 
in  Germany  over  the  next  two  decades.    These  devices  were  characterized 
by  their  bulk,  high  cost,  and  complexity.    More  recently,  a  new  type 
of  compressor  has  appeared  on  the  market  that  is  portable,  inexpensive, 
and  simple.    This  compressor ^has  been,  made  possible  through  the  use  of 
large-scale  integrated  circuits  that  are  characteristic  of  modern 
technology.    Thus,  it  is  now  feasible  for  individuals  to  have  their  own 
personal  speech  compressor,  just' as  it  is  feasible  for  them  to  have  their 
own  pocket  calculator.     If  a  learner  has  purchased  or  prepared  tape 
recorded  educational  material.^  by.  playing  back  this  material  using  a 
modem  speech  compressor,  he  can  continually  adjust  the  speed  at  which 
,he  listens  to  suit  his  own  needs. 

The  development  of  speech  compressors  and  the  consequent  option  on  . 
the  part  of  the  listener  to  listen  to  recorded  materials  at  various  rates 
has  prompted  a  number  of  studies  of  variables  affecting  the  intelligibility 


of  individual  words  as jWell  as  the  comprehension  of  connected  discourse. 
A  substantial  amount  of  this ' research  was  described  at  three  national 


Er|c  :  525 


'  Processing  Time 

 ^ —  — — — — : — 

compressed  speech  conferences  held  in  1966,  1969,  and  1975.  A 
review  of  much  of  this  research  was  published  by  Foulke  and  Sticht 
(1969).    An  extensive  anthology  and  annotated  bibliography  in  three 
volumes  was  published  by  Duker  (1974).    Much  of  the  research  that  has 
been  done  is  dependent  on  studies  done  earlier  involving  speech  at 
normal  rates. ^  Therefore,  such  concepts  as  that  of  information 

!  '  ■ 

processing  have  been  useful  in  compressed  speech  research.    No  attempt 
will  be  made  here  to  summarize  all  of  the  research  concerned  with 
compressed  speech,  but  rather  only  the  research  that  has  led  up  to 
the  present  study. 

The  comprehension  of  discourse  has  been  a  primary .  empirical  domain 
of  concern  to  cognitive  theorists  (e.g..  Just  and  Carpenter,  1977). 
Most  of  the  resear-*:^  has  been  concerned  with  reading,  although  it  is 
not  uncommon  for  listening  to  discourse  to  be  included  within 
theoretical  formulations  (e. g. ,  Kintsch,  1977).    The  fundamental 
variable  that  def ir      time-cobpressed  speech  is  ,the  words-per-minute 
(wpm)  rate  at  which  recorded  material  is  presented.    As  would  be 
expected,  given  a  r    .  ^iciently  high  wpm  rate,  comprehension  declines 
drastically.    ?ov  ■ -^^  and  Sticht  (1969)  wrote,  "The  increase  in  rate  at 
which  comprehension  declines  beyond  275  wpm  suggests  that  when  a  certain 
critical  word  rare  is  reached,  a  factor  in  addition  to  signal  degradation 
[i.e.,  distortion  introduced  by  the  process  of  time  compression]begins 
to  determine  the  loss  of  comprehension.    The  understanding  of  spoken 
language  implies  the  continuous  registration,  encoding,  and  storage 
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of  speech  information,,  and  these  operations  require  time  (italics 
added).    When  the 'word  rate  is  too  high,  words  cannot  be. processed 
as  fast  as  they  are  received,  with  the  result  that  some  speech 
information  is  lost"  (p.  60).    Hughes  and  Foulke  (1975)  found  that 
one  effect  of  signal  degradation  is  to  slow  down  the  processing  of 
"speech  informat^ on,  thereby  contributing  to  the  total  time  required 

for  the  understanding  of  spoken  language.    In  their  experiment, 

r 

highly  compressed  isolated  words  were  identified  less  rapidly  by 
listeners,  and  it  was  concluded  that  this  result  sup^brted  further 
the  position  of  Foulke  and  Sticht  (1967)  that  the  decrement  in 
comprehension  of  connected  speech  as  wpm  rate  increases  is  at  least 
in  part  a  function  of  the  increasingly  limited  time  available  to  the 
listener  to  process  speech  information.    This  result  is  consonant  " 
with  Aaronson's  (1967)  conclusion  based  upon  the  results  of  several 
studies  that  "experimental  evidence  indicates  that  processes  continue 
to  occur  after  the  physical  stimulus  presentation— either  auditory  or 
visual— is  terminated,    Interference  with. or  termination  of  these 
post-presentation  perceptual  processes  can  lead  to  decreased  recall 
accuracy"  (p.  136).    An  example  of  these  studies  was  one  done  by 
Aaronson  (in  Aaronson,  1967,  p.  134).    She  compressed  spoken  digits 
in  sequences  of  seven  but  left  the  rate  of  their  presentation 
unchanged.    Recall  of  the  sequences  was  more  accurate  for  the  compressed 
than  for  the  original  digits.    She  presumed  that  providing  more  silent 
time  allowed  more  adequate  perceptual  processing  and  hence  more  accurate 
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recall. 

Chodorow  (1979)  has  made  use  of  time--compressed  speech  in  an 
attempt  to  detect  and  differentiate  lexical  and  syntactic  processing 
when  isolated  sentences  rather  than  isolated  words  or  digits  are  used. 
In  reviewing  prior  research,  he  drew  attention  to  the  conclusion  that 
lexical  processing  occurs  only  in  close  proximity  to  a  given  word, 
while  syntactic  processing  may  be  "strung  out."    He  reasoned  that  he 
could  track  the  processing  of,  an  auditory  sentence  occurring  after 
that  sentence  had^been  completed  by  following  the  sentence  with  an 
auditory  word  li^t  having  its  onset  after  various  lengths  / 
of  pauses  between  the  conclusion  of  the  sentence  and  the  onset  of  the 
word  list.    Presumably,  with  a  shorter  pause,  processing  of  the 
sentence  would  tend  to  compete  with  listening  to  the  subsequently 
presented  word. list,  and  both  the  recall  of  the  sentence  and  the 
recall  of  the  word  list  would  show  decrements.    He  was  especially 
interested  in  such  effects  resulting  either  from  (a)  an  ambiguous 
word  in  a  sentence  or  from  (b)  syntactic  complexity.    Also,  he 
reasoned  that  ±a  using  time-compressed  speech  where  the  wpm  rate 
is  high,  presumably  the  processing  of  a  concluded  sentence  would 
be  even  more  likely  to  continue  during  the  period  when^ the  word  list^ 
was  being  presented.    With  an  Wbiguous  word  in  each  sentence^  he 
found  that  a  decrement  in  recall  of  the  ambiguous  word  resulted^ 
from  "premature  truncation  of  some  ambiguity  resolution  procedure" 
(p.  100).    Although  a  longer  pause  between  sentence  and  word  list 
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improved  performance,  this  effect  was  not  statistically  significant. 
However,  with  a  variation  in  syntactic  complexity  (in  his  words, 
structural  indeterminacy),  it  was  found  that  with  more  complex 
sentences,  a  shorter  pause  time  produced  a  significant  decrement  in      —  t 
recall  of  the  word  list,'  consistent  with  the  view  that  with  increasing 
complexity,  processing  continues  longer  after  the  sentence  is  over. 
Also,  a  longer  pause  Improved  sentence  recall  following  less  complex 
sentences  when  they  were  compressed,  but  not  following  more  complex 
sentences.    Apparently . the  more  complex  sentence^  required  more  pause 
time  than  the  longer  of  the  two  values  of  pause  time  that  were  used. 

Overmann  (1971)  also  investigated  the  effect  of  introducing 
pauses  in  compressed  speech,  but  she  introduced  them  between  phrases^ 
and' sentences  in  discourse  rather  than  in  relation  to  single  sentences. 
She  divided  the  time  saved  in  the  process  of  compression  among  phrase 
and  sentence  junctions,- thus  replacing  the  processing  time  lost  through 
compression.    The  result  was  that  performance .was  improved  significantly 
compared  with  compression  without  such  replacement.    However,  there  was 
.still  some  decrement  in  performance  in  relation  to  the  control  (normal 
rate)  con^-«tion.    Presumably,  this  remaining  decrement  was,  due  to  both 
signal  degradation  and 'to  consequent  insufficient  time  for  identifying 
individual  words,  as  suggested  by  Hughes  and  Foulke  (1975).  ^ 

The  results  of  Aaronson  (in  Aaronson,  1967),  Chodorow  (1979),  and 
Overmann  (1971)  suggest  that  providing  additional  processing  time  improved 
recall  of  either  a  sequence  of  digits,  an  isolated  sentence,  or  discourse. 
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There  is  evidence  that  the  amount  of  processing  time,  needed  for^     ^      -  - 
kdequate  retention  following  the  brief  presentation  of  pictures  is 
approximately  1  sec  and  under  some  conditions  even  less  (Sheikhian, 
Fleming,  &  Hughes,  1975).    Presumably,  knowledge  about  such  processing  . 
requirements  in  discourse  can  provide  ways  of  improving  its  comprehension. 

Even  though  an  adequate  amount  of  processing  time  is  available  at 
sentence  bounda.ries,  the  unintelligibility  of  individual  words  may 
interfere  with  adequate  comprehension  of  discourse.    As  indicated  above,  . 
this  may  be  both  because  of  a  degraded  signal  per  se  and  because  such 
a  signal  results  in  an  inordinate  consumption  of  time  even  if  it  is 
finally  identified.    It  will  be  recalled  that  Chodorow  (1979)  pointed 
to  evidence  that  lexical-  processing  occurs  only  in  close  proximity  to 
a  given  word.    On  that  basis  we  might  speculate  that  words  that  require 
an  inordinately  long  time  for  identification  will  simply  be  missed. 
However,  this  may  not  happen  if  redundancy  is  increased  by  some  means, 
fbr  Sticht  (1969)  found  evidence  that  signal  distortion  is  of  less 
_CQnsequence  when  redundancy  is  increased.    Levin  and  Lesgold  (1978) 
have  reviewed  research  concerned  with  the  presentation  of  pictures  that 
are  considerably  redundant  with  respect  to  concurrent  auditory  discourse 
at  normal  wpm  rates.    A  number  of  studies  has  shown  that  young  children's 
comprehension  in  these  circumstances  is  consistently  improved.  Hughes, 
Langdon,  and  Kim  (1981)  measured  such  an  effect  at  various  wpm  rates 
and  obtained  results  confirming  those  described  by  Levin  and  Lesgold 
(19|78).    They  had  speculated  that  the  use  of  redundant  pictures  would 
facilitate  comprehension  to  an  even  greater  degree  at  higher  wpm  rates. 
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This  speculation  was  based  up9n  Hughes  and  Foulke's  (1975)  finding 
that  uore  highly  compressed  words  are  identified  more  slowly.  It 
^ seemed  likely  to  them  that  the  redundant  information  in  pictures 
would  increase  the  probability  .that  critical  words  in  the  discourse 
would  be  identified  within  the  relatively  brief  amount  of  time  during  .  .  „ 
which  this  would  be  'possible.    They  spoke  of  the  possible  replacement 
by  redundancy  in  pictures  of  the  redundancy  in  discourse  that  was.  lost 
through  time  compression.    Their  results  were  in  the  predicted  direction 
•in  three  experiments,  but  they  were  not. statisticallir  significant. 
#  ;    An  alternative  view  to  that  taken  by  Hughes,  Langdon,  and  Kim  (1981) 
is- that  a  picture  may  itself  transikt • information  that"  allows  the  viewer 
to  answer  a  question  that  has  been  composed  to  test  a  listener's 
coraprehensidn  of  a  sentence,  which  that. picture  accompanies.  "That  is  to 
say  that  the  picture  may  not  ac.t  to  make  an  auditory  sentence  more 
coraprehensiblev  but  Instead  may  transmit  information  contained  in 
.that  sentence  while  tl.e  sentence  itself  remains  incoiiprehensible.  ' 
the  Hughes  et  al.   (1981)  study,  some  of  the  third  grade  children  " 
listened  to  discourse  at  a  very  high  rate,  namely,  375  wpm.    The  usual 
conditions  of  listening  to  the  discourse  alone  and  listening  to  discourse 
accompanied  by  pictures  were  used,  but  also  the  pictures  that  had  been 
used  previously  only  in  conjunction  witii  the  recorded  discourse  were  for 
^the  first  time  presented  alone,  at'  durations  that  were  the  same  as  when 
they  were  presented  along  with  the  discourse.    The  results  were  that 
subjebts  who  saw  the  pictures  alone  performed  equally  as  well  as  those 
who  both  saw  the  pictures  and  listened  to  the  discourse  at  375  wpmj 
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However,  those  who  only  listened  to  the  discourse  perfoirmed  at  stich  ^ 

(.  '  •  -  ' 

a  low  level  that  they  seemed  to  be  understanding  virtually  nothing 

n  .  ,  *  — ^   ;  ■  \  . 

of  what  they  heard.    This  result  suggests  that  the  pictures  may,  indeed,  . 

■  <« 

have  been  primarily  transmitting  informatiox?  directly  rather  than 

.  "3  '  ■  * 

acting' to  make  the  discourse  understandable.     Of,  course, ^at  the  rate  of 
375  wpm  it  could  be  that  the/discourse  could  not  have  been  made  - 
understandable  by  any  means  whatsoever.     In  the  present  study,  rates 
lower  than  375  wpm  were  used,  and  therefore  it  seemed  necessary  to 
include  the  condition  of  presenting  the  pictures  alone. 

Further,  we  might  say  "that  if  the  .character  of  tfie  pictures  were  ^ 
such  as  to  provide  a  context  for  the  information  contained  in  the  , 
discourse  rather  than  to  provide  that  sam^r  information,  then  perhaps 
the  discourse  would  be  made  more  comprehensible,  making  ^  claim  for  the 
pictures*  bringing  about  greater  comprehension  of  the  text  more 
believeable.    In  research  discussed  by  Chodorow  (1979),  subjects*' 
interpretation  of  a  lexically  ambiguous  sentence  could  be  biased  toward  - 
either  sense  of  the  ambiguity  by  providing  an  appropriate  context  sentetice 
to  one  pf  their  ears  while  they  lij^tened  to  the  ambiguous  sentence  in"' the 
other 'ear.    The  use  of  a  picture  that  provides  context  for  -a  sentence  - 
is  aomewhat  analogous  to  Chodorow' s  procedure. 

The  decision  was  made  to  attempt  to  change  the  questions  for  some 
subjects  in  such  a  manner  as  to  nake  the  pictures  contextual  rather  than 
redundant — that  is,  to  change  them  such  that-it,  seemed  likely  that  they 
could  not  be  answered  on  the  basis  of  seeing  the  pictures  but  could  be 
answered  on  the  basis  of  hearing  the  discourse.    In  some  instances  it  was 


511 

532 


Processing  Time 
13 


not  possible  to  make  such  changes.    However,  enough  such  changes 
could  be  made  to  make  it  seem  reasonable  to  incorporate  as  ^  fourth 
independent  variable  the  nature -o'f  the  relationship  between  the 
disccurse  and  the  pictures .    That; is ,  the  pictures  would  function 
either  as  a  source  of  redundant  information. with  respect  to  the 
sentences  or  else  the.  pictures  would  function  as  a  context  ,for  the 
sentences,  with  the  presumption  that  in  either  case  the  sentences 
would  becoine  more  .comprehensible  as  a  result.    However,  it  seemed 
likely  that  redundant  pictures  would  improve  comprehension  more  than 
contextual  pictures  would.    A. redundant  picture  provides  information 
that  may  not  have  been  transmitted  successfully  by ^a  time-compressed 
sentence,  while  a  contextual  picture  only  increases-  the  probability 
'that  the  sentence  transmits. its  information.    Guttman,  Levin,  and 
Pressley  (1977)  found  results  consonant  with  this  conjecture  when 
kindergarten  children  were  subjects  but  not  when  second  and  third 
graders  were  subjects.    Their  redundant  ("complete")  pictures 
depicted  a  critical  object  while  their  contextual  ("partial") 
pictures  depicted  only  the  environment  of  the  object.     An  experiment 
with  similar  results  was  done  by  Pressley,  Pigott,  and  Bryant  (1982). 
Of  course,  in  the .present . experiment,  higher-than-normal  wpm  rates 
were  used,  and  even  for  older  children  it  seemed  likely  that  redundant 
.  pictures  would  improve  comprehension  more  than  contextual  pictures 
would  ir  view  of  the  redundant  pictures'  providing  information  that 
„.ay  have  not  been  transmitted  successfully  at  the  higher  rates. 
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As  indicated  in  the  preceding  paragraph,  some  of  the  questions 
were  to  be  changed  to  give  the  pictures  a  contextual  function  racher 
than  a  redundant  function.     The  question  arose  as  to  whether  the  two 
forms  of  the  questions  were  of  equal  difficulty.     If  they  differed  in 
difficulty,  then  difficulty  and  function  of  the  two  forms  would  he. 
confounded.     A  determination  of  the  relative  difficulty  of  these  two 
forms  was  made  during  the  course  of  the  experiment,  as  will  be  described 
later. 

The  purpose  of  the  present  research  was  to' explore  the  extent  to 
which  the  usual  decrease  in  the  comprehension  of  recorded  discourse 
by  young  children  as  wpm  rate  of  the  discourse  increases  is  less  as  a 
result  of  (a)  adding  pause  time  at  sentence  boundaries,  (b)  providing 
redundant  pictures,  and  (c)  providing,  contextual  pictures. 

Method 

Subjects 

— jf  ♦ 

Participants  were  144  fourth-  and  fifth-grade  students  in  local    •  ^ 

and  area  schools.     The  participants  were  randomly  assigned  in  equal 

numbers  to  each  of  24  experimental  conditions  resulting  from-the 

combination  of  two  pause  times,  two  rates,  two  presentation  conditions, 

and  two  question  types,  and  to  eight  control  conditions  where  only  the 

pictures  were  presented. 

Apparatus  '  V  / 

The  experiment  was  conducted  at  each  of  four  schools.  The^ 
experimental  room  was  a  room  that  was  made  available  at  each  school.  / 

Each  room  provided  a  quiet  and  private  environment.. 

.       •  '  .  '  / 
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A  Dukane  Micromatic  II  Sound  Films  trip  Projector  was  useci  to 
project  films trips.    The  discourse  was  recorded  on  Maxell  cassette 
capes.    Two  sets  of  high  quality  earphones  together  with  a.  junction 
bi..:  were  used  to  allow  both  the  subject  and  the  experimenter  to 
listei.  ^o  a  story. 
Materials  , 

The  discourse,  pictorial,  and  test  materialj  of  Bender  and  Levin 
(1978)  were'used.     The  discourse  and  pictorial  materials  consist  of 
a  20-sentence,  fictitious  story  titled  "Joseph,  the  Border  Guard" 
together  with  20  line  drawings  with  watercolor  embellishment,  one  for 
'each  of  the  sentences.     For  each  sentence  there  is  a  question  that  can 
be  answered  with  a  word  or  a  short  phrase.    These  questions  correspond 
to  a  level  of  comprehension  of  discourse  described  by  Perfetti  (1977) 
as  questions  that* "require  information  based  on  a  semantic-syntactic 
analysis  of  the  sentence  and  are  the  kfnd  of  'literal  questions* 
(referential^  not  inferential)  that  test  construction  is  familiar 
with"  (p.  22).     For  exampl^,  the  first  sentence  is,  "Once  upon  a  time 
there  was  a  small  kingdom  ruled  by  a  king  who  lived  on  a  hill  outside 
of  the  kingdom."    However,  eight  "^of  these  questions  were  changed  for 
some  subjects  to  create  contextual  pictures  as  opposed  to  redundant 
pictures.     For  instance,  subjects  were  presented  a  picture  of  a  castle, 
on  a  hill  outside  of  a  kingdom.     Subjects  in  the^  redundant  pictures 
condition  were  asked,  "Where  did  the  king  live?"^xthe  contextual 
pictures  condition,  subjects  were  asked,  "Who  lived  on  the  hill  outside 
of  the  kingdom?"    The  picture  did  not  show  the  king  but  only  the  place 
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where  he  lived.    The  first  question  made  the  picture  redundant  since 
it  required  the  subject  to  provide  information  in  the  picture  (place 
Jived).     The  second  question  made  the  picture  contextual  since  it 
required  the  subject  to  provide  information  not  in  the  picture  (who 
lived  in  that  place).     Rules  were  adopted  to  define  correct  responses 
to  the  questions.   'Practice  materials  consist  of  a  three-sentence 
story  together  with  three  line  drawings  with  water color  embellishment. 
The  sentences  had  been  tape  recorded  for  use  in  the  Hughes  et  al. 
study,  with  broadcast  quality  at  150  wpm  by  a  professioual  reader. 
This  tape  was  compressed  to  each  of  two  rates,  225  and  300  wpm,  using 
a  Varispeech  II  Speech  Compressor.    Following  each  recorded  sentence, 
there  was  a  single  50  cps  tone  on  the  taipe  for  the  experimental 
conditions  where  the  pause  was  0  sec.     This  tone  advanced  a  filmstrip 
consisting  of  the  20  line  drawings  to  the  next  frame.     However,  for  the 
experimental  conditions  where  the  pause  was  4  sec,  following  each 
recorded  sentence  there  were  two  successive  50  cps  tones  on  the  tape. 
The  two  tones  were  separated  by  4  sec  in  terms  of  tape  transport  time. 
Each  of  these  tones  advanced  the  filmstrip  projector  by  one  frame.  A 
second  filmstrip  consisting  of  the  20  line  drawings  was  constructed 
such  that  there  was  a  blank  frame  between  successive  draviings.     In  this 
way^the  first  of  the  pair  of  50  cps  tones  advanced  the  filmstrip  to  a 
blank  frame  and  thus  removed  the  current  drawing,  while  the  second  tone 
advanced  the  filmstrip  to  the  next  drawing.     The  filmstrip  projector  is 
constructed  such  that  the  50  cps  tone  is  inaudible. 
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Procedure 

The  projector  was  set  up  at  a  distance  of  5.5  ft  (1.7  m)  from 
a  wall  of  the  experimental  room  to  produce  a  12  x  18  in  (30  x  45  cm) 
image.     The  image  was  projected  on  a  piece  of  22  x  28  in  (56  x  71  cm) 
white  cardboard  that  was  mounted  on  the  wall.     Subjects  participated 

one  at  a  time.    Order  of  experimental  conditions  was  random  with  the 

i 

restriction  that  there  were  six  replications  of  each  condition.  The 

1 

subjects  were  seated  on  the  right  side  of  the  projector  and  were  7  ft 
(2.1  m)  away  from  the  screen.    The  subjects  were  given  instructions 
in  keeping  with  experimental  conditions  to  inform  them  thatlthey 
would  be  listening  to  a  story,  with  or  without  accompanying  pictures, 
oir  would  be  watching  a  series  of  pictures  that  in  themselves  tell  a 
story,  and  that  afterwards  they  would  be  asked  some  questions^ about  it. 
They  were  given  practice  materials,  including  questions,  under  the  same 
condition  to  whicjti  they  had  been  assigned.    After  the  instructions  and 
examples  had  been  provided  the  subjects,  they  listened  to  the  sentences, 
with  or  without  accompanying  pictures,  or  saw  the  pictures  alone,  and 
then  were  asked  questions.     Questions  were  asked  and  answered  orally  in 
the  same  order  as  the  sentences.     The  experimenter  wrote  down  the  answers 
on  answer  sheets.    When  each  subject  finished,  s /he  was  asked  not  to  talk 
about  the  story  with  friends\ until  the  study  had  been  completed  at  that 
particular  school.  \  - 

Design 

The  four  independent  variables — pause  time,  wpm  rate,  presentation 
condition,  and  question  type—were  combined  in  a  2x2x2x2  factorial  design. 
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The  reason  that  the  design  implies  only  two  values  of  the  presentation 
condition  variable  is  that  the  condition  of  presenting  pictures  alone 
was  "treated  as  a  control  condition  for^ the  purpose  of  comparing  the 
amount  of  information  transmitted  by  the  pictures  alone  with  the  amount 
transmitted  by  the  discourse  alone,  in  a  sepai-ate  analysis.     A  second 
control  atialysis  was  done  to  determine  whether  the  two  sets  of  eight 
questions  each,  that  differed  in  their  function  of  making  the  pictures 
either  redundant  or  contextual,  were  of  equal  difficulty.    For  this 
'purpose,  the  data  from  subjects  who  only  listened  to  the  discourse  was 
used.     A  third  and  final  control  analysis  was  done  to  verify  that  the 
questions  designed  to  give  the  pictures  different  functions  did,  indeed, 
give  them  those  functions.    Data  from  subjects  who  had  seen  the  pictures 
but  had  not  listened  to  the  discourse  were  used.     Clearly,  the  redundant 
questions  should  result  in  more  correct  answers  than  t^e  contextual 
questions  because  the  redundant  questions  pertained  to  information 
contained  in  the  pictures,  while  the  contextual  questions  did  not.  The 
level  of  significance  adopted  for  all  statistical  analyses  was  .05. 

Results 

The  results  will  be  described  in  terms  of  performance  on  the  8 
questions  of  the  original  20  in  order  that  direct  comparisons  involving 
the  redundant  and  the  contextual  functions  of  the  pictures  may  be  made. 
Also,  as  it  turned  out,  results  involving  all  20  of  the  questions ^were 
equivalent  to  those  involving  only  the  8  questions  and  would  provide 
only  redundant  information. 
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Table  1  shows  the  mean  number  of  correct  answers  out  of  eight 
for  the  various  combinations  of  values  of  the  four,  independent 
variables.    The  results  of  an  analysis  of  variance  for  these  data 
are  shown  in  Table  2. 


Insert  Table- 1  and  Table  2  about  here 


The  main  effect  of  pause  time  was  not  significant  (Table  2). 
The  mean  number  of  correct  answers  for  a  4-sec  and  a  0-sec  pause 
were,  respectively,  A. 89  and  5.04.    However,  a  question  of  greater 
interest  was  whether  as  the  rate  of  discourse  increased,  adding 
pause  time  resulted  in  less  loss  in  comprehension  than  when  pause 
time  was  not  added.  "  This  question  corresponds  to  the  rate-by-pause- 
time  interaction,  which  was  significant  XTable  2),    As  shown  in  Table 
3,  the  nature  of  that  interaction  was  that,  whereas  with  a  4-sec 
pause  the  decrease  in  mean  number  of  correct  answers  as  rate  increased 
was  1.37,  with  a  0-sec  pause  the  decrease  was  2.75.    A  simple  main  , 


Insert  Table  3  about  here 


effect  test  of  the  significance  of  each  of  these  two  differences 
showed  that  each  was  significance  (F  =  8.97  and  36.16,  respectively). 
Thus,  with  increasing  rate,  the  4-sec  pause  resulted  in  a  significantly 
smaller  loss  in  comprehension  than  did  the  0-sec  pause.    Pausi  time,  was 
thus  shown. to  be  of  consequence  in  spite  of  not  being. a  significant 
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main  effect.  \ 

Unlike  the  main  effect  of  pause  time,  the  main  effect  of  wpm 

rate  was  significant  (Table  2).    T^e  mean  numbers  of  correct  answers 

for  the  two  wpm  rates  of  225  and  300  were  6.00  and  3. 94 ,  respectively. 

As  just  described,  wpm  rate  interacted  with  pause  time.     In  addition, 

■\     .  .. 
rate  interacted  with  presentation  conciition  (Table  2).    As  shown  in 

\ 

Table  4,  the  nature  of  that  interaction  was  that,  whereas  the  increase 
in  mean  number  of  correct  answers  at  the  lower  rate  when  pictures  were 
added  was  1.08,  the  increase  at  the  higher  rate  was^ 2.38.     Thus,  the 


Insert  Table  4  about  here 


facilitating  effect  of  pictures  was  appro ?cimately  twice  as  great  at  the 
higher  rate  as  at  the  lower  rate.    Each  oi    h^se  increases  was 
significant  (F  -  5.58  and  2^.08,  respectively),  in  keeping  with  the 
significance  of  the  main  effect  of  presentation  condition  (Table  2). 
•The  mean  numbers  of  correct  answers  for  the  dlscourge-alone  condition  ^ 
and  the  discourse-and-pictures  condition  were  4.15  and  5.84,. 
respectively. 


 AIOiougTPthe  main  effect  of  question  typ^  was  hot  significants 

it  interacted  with  presentation  condition  (Table  2).    Table  5  shows 
the  nature  of  that  interaction.     Improvement  i^  mean  performance  was 


Insert  Table  5  about  here 
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about  four  times  as  great  in  the  case  of  questions  that  made  the 
pictures  redundant,  2.75,  as  in  the  case  of  questions  that  made  th'fe 
pictures  contextual,  -71.     The  first  of  these  two  mean  differences 
was  significant  (F^  =  36,16),  while  the  second  was  not  significant 
(F  =  2.41).     Thus,  adding  pictures  that  had  a  redundant  function  was 
facilitative,  while  adding  pictures  that  had  a  contextual  function 
was  not. 

^     It  will  be  recalled  that  three  analyses  were  done  for  control 
purposes.     In  the  case  of  the  presentation-condition  variable,  a 
question  of  considerable  interest  concerns  the  extent  to  which 
subjects  were  able  to  answer  the  questions  after  having  seen  the 
pictures  without  having  heard  the  discourse.    As  pointed  out  earlier, 
the  pictures-alone  condition  may  therefore  be  characterized  as  a 
control  condition.    Tfie  mean  number  of  correct  answers  out  of  a  total 
of  eight  for  subjects  who  listened  to  the  narrative  was  4.21,  while 
the  mean  number  for  subjects  who  saw  the  pictures  was  3.29.  The 
difference  between  these  means  was  significance  (F^  =  6.86).  However, 
it  is  clear  that  performance  by  subjects  who  saw  the  pictures  was 

sub  s  tant  ial .__  :   

The  second  control  question  was  whether  the  two  sets  of  eight 
questions  each,  that  differed  in  their  giving  the  pictures  the  function 
of  being  either  redundant  or  contextual,  were  of  equal  difficulty.  To 
answer  this  question,  an  analysis  was  done  using  data  from  those 
subjects  who  only  listened  to  the  discourse.    For  redundant  questions, 
the  mean  number  of  correct  answers  was  3.75,  while  for  contextual 
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^  quesfrions,  the  mean  was  4.46.    The  difference  between  these  means 

was  not  significant  (F  =  2.18).    Thus,  it  appeared  that  the  intended 
function  of  the  pictures,  redundant  or  contextual,  w^s  not  confounded 
with  the  variable-of  -level- of  difficulty. 

The  third  and  final  control  question  was  whether  the  redundant 
and  contextual  questions  actually  resulted  in  the  pictures'  having 
'     these  respective  functions.     To  answf-r  this  question,  an  analysis  was 
done  using  data  from  those  subjects  who  only  saw  the  pictures.  For 
redundant  questions,  the  mean  number  of  correct  answers  was  4.33,  while 
for  contextual  questions,  the  mean  was.  2.21.     Thus,  the  questions 
appeared  to  have  given  the  pictures  their  intended  functions,  in  general. 
The  failure  of  the  mean  number  of  correct  answers  for  contextual 
questions  to  be  equal  to  zero  would- seem  to  have  been  due  to  subjects' 
prior  knowledge  and  to  lack -of  independence  of  the  content  of  the 

u»  ■  . 

various  pictures. 

Discussion 

One  of  the  more  notable  results  of  the  present  study  is  that,  all  four 
of  the  independent  variables  were  involved  in  one  or  more  significant 

interactions,  whereas'  only  two  of  the  main  effects-were- significant. :   , 

These  two  effects,  wpm  rate  and  presentation  condition,  were  each 
involved  in  two  of  the  three  interactions.    Thus,  under  the  conditions 
of  the  present  study,  answers  about. the  effect  of  individual  independent 
variables  must  be  qualified  with  respect  to  the  specific  values  of  one 
or  more  other  independent  variables. 
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It  will  be  recalled  that  several  studies  were  described  earlier 
that  were  concerned  with  the  general  hypothesis  that^under  some 
circumstances  people  continue  to  process  verbal  stimuli. after  these 
stimuli  have  been  terminated.     It  was  these  studies  that  led  to  the 
investigation  in  the  present  experiment  of  the  effect  of  introducing 
additional  processing  time  between  successive  sentences  in  connected 
discourse.     The  results  of  these  prior  studies  were  confirmed  in  the 
present  study  but  only  under  certain  conditions,  as  implied  in  the 
statements  above  about  interactions  between  the  independent  variables. 
The  present  study  waa  related  procedurally  more  to  some  than  to  others 
of  the  prior  studies,  but  from  the  point  of  view  of  the^ general 
hypothesis  identified  above,  it  would  seem  to  be  related  to  all  of  them 
equally.     In  the  Hughes  and  Foulke  (1975)  study,  there  was  evidence 
that  the  processing  h  individual  words  to  be  identified  continues  for 
some  time  after  the  words  have  been  presented,  when  the  words  are 
highly  compressed.     This  evidence  was  based  upon  longer  times  taken 
to  identify  the  words  at  higher  values  of  compr^ession.     In  the  study 
described  in  Aaronson  (1967)  there  ^was  evidence  that  each  of  a  seiries 
of  numerical  digits  continues  to  be  processed  after  its  presentatira.. 
This  evidence  was  based  upon  greater  recall  of  the  digits  after  the^^ 
had  been  time  compressed  to  create  additional  time  between  them.  In 
the  Chodorow  (1979)  study,  there  was  evidence  that  the  processing  of 
a  time-compressed  sentence  continues  after  its  presentation.  This 
evidence  was  based  upon  greater  recall  of  the  sentence  as  well  as 
gr-ater  recall  of  a  list  of  words  that  followed  the  sentence  when  the 
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interval!  of  time  between  the  end  of  the  sentence  and.  the  beginning 

!  . 

of  the  list  of  words  was  ^longer.    Finally,  in  the  Overmann  (1971) 

■•1 

study,  there  was  evidence  that  the  processing  of  phrfJues  arid 

sentences  in  time-con^ressed  discourse  continues  aftvr  their  termination. 

This  eviclence  was  based  upon  greater  comprehension  of  Lhe  discourse 
i  .  .  ■        '  . 

I  .  ■  / 

when  the! time  saved  through  time  compression  was  distributed  at 

phrase  and  sentence  boundaries.     It  will  be  recalled  that  in  the 
present  ^tudy  there  was  evidence  that  the  .processing  of  sentences 
continues  after  their  completion  inasmuch  as  at  the  higher  wpm  rate, 
the  mean  number  of  correct  answers  was  significantly  less  with  a  ^ 
0-sec  pause  than  with  a  4-sec  pause  between  sentences,  while  at  the 
lower  wpm  rate,  the  effect  of  length  of  pause  was  not  significant. 
This  result  in  the  present  study  is  unique  in  that  a '.rate  by  pause 
time  interaction  was  found,  although  it  seems  that  this  is  so  only 
because  rate  and  pause  time  had  not  been  manipulated  independently  \ 

with  the  exception  of  the  Hughes  et  al.   (1981)  study  where  a  similar 

1 

although  non-significant  result  occurred.    It  is  of  some  interest  to  . 
compare  the  present  study  with  other  studies  from  the  point  of  vigw  of 
'  experimental  design. 

In  the  Hughes  and  I^oulke  (1975)  study,  the  procedure  was  such 
that  neither  rate  nor  pause  time  was  involved  as  a  variable.  Words 
were  presented  at  fixed  intervals,  several  seconds  apart,  and  the 
identification  of  a  word  almost  invariably  would  be  made  long  before 
the  end  of  the  interval.     The  only  sense  in  which  rate  could  be  said 
to  be  inyolved  was  that  the  words  had  been  time  compressed  in  a  manner 
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corresponding  to  wh§t  would  have  been  various  wpm  rates  if  discourse^ 
had  been  the  material  that  was  compressed-     This  might  be  described 
as  a  momentary  rate;    The  only  sense  in  which  a  pause  was  involved' 
was  that  the  dependent  variable  was  reaction  time  in  identifying  the 
words,  a  "pause"  on  the  part  of  the  sul>ject — that  is,  the  subject 
needed  a  "longer  "pause"  when  rate-  was  higher. 

^  In  Aaronson's  (in  Aaronson,  1967)  study,  rate  of  occurrence  of 
the  digits  was  fixed.  .  Compression  of  the  digits  inqjroved  performance 
the  interpretation  being  that  more  time  was  left  for  processing  each 
individual  digit  before  the  next  one  was  presented.     If  rate  is 
equated  with  amount  of  compression  (momentary  rate) j  in  this 
procedure  rate  and  "pause  time"  were  positively  and  perfectly 
correlated. 

^    In  Chodorow's  (1979)  study,  it  would  have  been  possible  to 
comljine.  rate  and  pause  time  factorially,  but  this  was  not:  done.  He 
used  normal  and  twice  normal  wpm  rates  of  presentation  of  sentences 
but  used  two  values  of  pause  time  only  at  the  twice  normal  rate,  - 

In  Overmann's  study,  rate"  and  pause  time  were  positively  and 
perfectly  correlated  as  in  Aaronson* s  (in  Aaronson,  1967)  study. 
She  compared  comprehension  of  discourse  with  and  without  added 
pause  time  at  each  of  three  rates,  but  she  was  unable -to  evaluate 
rate  and  pause  time  independently  because  at  higher  rates,  paufje 
times  were  longer-.         ^  ^ 

The  finding  in  the, present  study  that  pictures  improved 
comprehension  more  at  a  higher  wpm  rate  than  at  a  lower  one  is  of 
.  «•  ■■■*>■ 
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considerable  interest.     If  the  present  finding  is  confirmed  in 
further  research,  it  may  have  importance  not  only  in  the  context 
of  compressjed  discourse  but  also  in  other  adverse  listening 
donddeions.    It  i-s  interesting  to  speculate  how  Overmann's  results 
might  have  been  affected  by  the  use  of  pictures.    At  two  lower 
values  of  compression  she  found  that  the  addition  of  pause  time 
between  phrases  and  between  sentences  resulted  in  a  level  of 
performance  not  significantly  lower  than  that  of  subjects  who 
listened  to  the' original  (uncompressed)  version  of  the  discourse./  ^ 
However,  at  a  higher  value  of  compression,  performance  was 
significantly  lower.    The  reiilts  of  the  present  study  suggest 
that  with  pictures  available  to  this  latter  group,  performance 
might  have  been  maintained  at  the  level  of  that  achieved  by  subjects 
who  listened  to  the  original  version. 

.The  finding  in  the  present  study  that  adding  redundant  pictures 
to  discourse  improved  comprehension  more  than  adding  contextual 
pictures  was  similar  to  that  of  Guttman,  Levin,  and  Pressl^ey  (1977), 
obtained  with,  kindergarten  children  and  to  that  of  ^ressley,  Pigott, 
and  Bryant  (1982X  obtained  with  3-  and  4-year-old  chiidren.    In  t^ie 
"pressley'et  aK   (1982)  study,  adding  contextual  pictures  did  not 
improve  comprehension,  while  in  the  Guttman  et  al.  (1977)  study, 
contextual  pictures  improved  comprehension  in  thirdt^grade  students 
but  not  in  kindergairten  and  second-grade  students.    It  will  be 
recalled  that  contextual  -pictures  did  not  improve  comprehension  in 
the  present  sfudy.    There  is  not  a  consistent  relation  in  these 
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Studies,  taken  together,  between  the  effect  of  contextual  pictures 
and  chronological  age.     It  would  seem  that  either  chronological  age 
is  not  a  relevant  variable,  or  else  that  materials,  procedures,  etc. 
varied  among the  studies  in  a  way  to  obscure  any  such  relationship. 

The  manner  in  which  pictures  were  given  a  contextual  function  in 
the  present  study  is  somewhat  unsatisfactory.     It  necessitated 
confounding  the  function  of  the  pictures  and  the  very  content  of  the 
questions.     Although  the  outcome  of  an  analysis  suggested  that 
changing  the  content'  of  the  .questions  did  not  change  their  difficulty, 
a  more  direct  way  of  giving  pictures  a  redundant  or  a  contextual 
function  would.be  preferred,  and  this  would  also  allow  a  comparison  of 
the  functiona  of  20  pictures  instead  of  just  8.     Rather  than  changing 
the  questions,  a  new  set  of  pictures  could  be  created  that  were 
^contextual  rather  than  redundant  with  respect  to  the  discourse. 

The  finding  that  subjects  who  only  saw  the  pictures  answered  a 
substantial  portion  of  the  questions  makes  it  evident  that  the 
improvement  of  performance  through  the  use  of  pictures  may  not  be 
due  ab-/ll  to  the  pictures*  making  the  discourse  more  comprehensible. 
However,  it  is  conceivable  that* whereas  some  pictures  transmitted 

tyjP_r^Tg>vfl^  independently  of  the  discourse^  other  ^  

pictures  did  function  in  a  way  to  make  the  discourse' more 
comprehensible.    Also,  it  is  conceivable  that  a  given  picture  may 
have  functioned  in  a  different  way  for  different  subjects.  The 
issue,  can  be  resolved  only  by  designing  pictures  that  do  not  tra:nsmit 
the  information  necessary  for  answering  the  questions. 
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Finally,  it  would  seem  of  Interest  to  modify  the  present 
procedures  in  such  a  way  as  to  allow  subjects  to  '^ask  for"  pictures 
as  well  as  for  periods  of  pause  time.     It  might  be  that  the  most 
efficient  use  of  the  subject's  time  can  best/ be  ascertained  by ' 
allowing  him  such  choices.     Fdr  example,  equipment  could  be  arranged 
such  that  a  subject  who  was  listening': o  discourse  could  obtain 
brief  access  to  a  related  picture  by  pressing  a  button  once,  or  more 
extended  access  ty  pressing  the  button  several  times  at  short  Intervals 
A  procedure  of  this  kind  in  studying  the  contribution  of  the  audio 
'  and  video  portions  of  televised  instruction  was  used  successfully  in 
a  study  by  Kspbiech  (1976). 


\ 
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V       Theoretical  Bases  for  Research  in  Media 

A  pensistent  problem  facing  teachers  and  researchers  alike  is  finding 
the  answer  to  the  question:  What  point  of  view  should  I  assume  and  what 
evidence  should  I  use  to  determine  the  effects  of  media  upon  learners  and 
the  ways  that'  learners  utilize  media' to  perceive, and  process  Information? 
After  many  yearS  ,of  research  in  media,  this  same-'' question  is  still  being 
asked  and  is  still  largely  unanswered,  at  least  to  the  degree  tji^at  there 
are^absolutes  to  guide  educators,  in  making  decisions.  Yet,  looking  at  this 
situation  'from  an  historical  perspective^  developments  over  the  past  ten  to 
fifte^'en  years  give  promise  of  more  definitive  directions. 

»  n  ■  ■ 

My  intentions  in  this  presentation  are .  threfi-fold.  One  is  to  make  a 
few  observations  about  the  major  paradigms  and  assumptions  that  have  shaped 
research  in  the  past.  A, second  is  to  encapsulate  the  activities,  thinking, 
paradigms  of  the  present.  A  third'^is  to  report  on  the  results  of  asking 
100  theoreticians  and  researchers  ^  respond  to  50  hypothetical  statements 
about  media  in  the  learning  process  as  a  way  to  ^sample  current  points  of 
view. 

It  is  probably  fair  to  say  that  most  studies  of  media  applications  to 
instruction  in  the  first  five  or  six  decades  of  this  century  were  built  • 
upon  linvitiM  theoretical  positipns._,J_hat  is,  the  effects  of  media  upon 
learners  were  analyzed  primarily  as  stimulus  presentations  which  were  to 
have  a  direct  influence  upon  subsequent  behavior.  Learners  were  assumed  to 
be"^  reactive  and.  under  stimulus  control.    For  example, , in  1963,  Ftnn,  in  his 
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definition  of  the  field  as  "instructional  technology,"  suggested  that  it 
was  ".  .  .  a  branch  of  educational  theory  and  practice  concerned  with  the 
design  and  use  of  messages  which  control  the  learning  process,"    But  there 


were  others  who 
Carpenter  (1957) 


had  a  different  viev/-  Several  years  earlier  than  Finn, 
contended  that  •  •  teaching  materials  are  effective 
.  .  .  depending  on  the  degrees  of  their  personal":  relevance  to  learneris' 
....  The  organism  or  individual  interposes  its  entire  relevant  life 
history  between  the' stimulus  material  and  his  or  her  response."  In  a  simi- 
lar vein,  Hartman  (1963)  in  a  review  of  learning  theory,  emphasized  ".  .  . 
facilitation  or  interference. with  learning  that  arises  from  the  cognitive 
organization  the  res"pondent  imposes  upon  the  message." 

While  there  were  others  thinking  as"  Carpenter  and  Hartman,  most  media 
studies  were  characterized  in  the  familiar  "gross  comparisons" °  format. 
Such  research  seemed  a  natural  reaction  to,  the/expanding  availability  of 
media  through  federal  funding  and  the  eagerness  of  producers  to  push  for 
adoption.  It  seemed  that!  there  was  more  of  a  need  to  prove  the  utility  of 
media  for  the  improvement  of  education  than  there  was  a  need  to  analyze  the 
peculiar  characteristics  of  media  themselves.  Much  research  studied  learn- 
ing with  media  Vather  thin  studying  about , media  effects  upon  learning.  All 
of 'us  are~f-arniliar' "wi'tF^f^  oft-repeated  phrase  "no  significant  differ- 
ences" that  has  c;h3racterized  such  research.  Subsequent  analyses  have 
criticized  the  assui\>{.tl6n  that  global  forms  of  media,  such  .as  television  or 
films,  could  be  regti'-ded  as  unambiguous  entities  that  somehow  could  be 


537 


558 


: .  '  ^  -     •  I 

■     ■  •  / 

Theoretical  Bases  for  Research  in/Media 

described  and  controlled  to  determine  a  Couse  and  effect  relationship  with 

•  ■•  ■  /  . 

any  precision.    Additional  criticism  focused  on  the  theoretical/  assumption 

■ '       ■  '  j' 

that  regarded  learner  responses  as  being  directly  influenced  jiy  the  stimu- 
lus input,  with  little  regard- for  either  the  contributions yto  outcomes  of 
learner  idiosyncracies  or  the  peculiar  characteristics  of /the  media  them- 
selves. •  / 

Mdre  recent  analyses  of  viable  ways  to  conduct  research  and  to  define 
the  nature  of  fundamental  research  questions  have  focused  on  the  confound- 
ing effects  of  uncontrolled  variables.  "  Clark  '  (1983)  for  example,,  has 
suggested  that  much  of  media  research— that  is,  that  which  has  been 
reported  as  media  research— has  actually  been  a  study  of  variable  method- 
ologies  and  settings  in  the  uses .of  media."  I  would  tend  to  agree,  but  with 
a  recognition  that  there  have  been  exceptions.  One  that  comes  to  mind  is 
the  film  studies  done' under  Carpenter's  directions  In  the  Instructional 
Film  Program  at  Penn  State  back  in  the  40s'  and  50s.  In  some  of  those 
Studies  there  were  deliberate  analyses  of  variables  within/films  themselves 
as  these  affected  the  performance  o^  subjects.  -On  the  other  hand,  subjects 
were  not  questioned  to  determine  which  variables  were  preferred;  neither, 
were  learner  repertoires  explored  to  determine  what, affected  their  inter- 
pretation of  stimulus  elements. 

Added  to  the  problem  of.  determining  defensible  theoretical  paradigms 
for  research  in  media  are  assumptions  about  th-e  conditions  necessary  in  a 
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research  setting  to  derive  generalizations  from  methods  and  statistical 

analyses.    I  refer  to  the  controversy  between  the  assumptions  and  arguments 

of  those  who  take  a  reductionist  view  of  research,  and  those  who  advocate 

naturalistic  inquiry  as  a  more  realistic  approach  to  what  life  is  outside  - 

the  laboratory  setting  (Magoon,  1977;  Guba,  . 1981)^     I  do  not  j"ntend  to 

discuss  the  intricacies  of  each  point  of  view,  but  rather  to  suggest  that 

our  in-itial  orientations  to  what  needs  to  be  investigated  and  under  what 

conditions   quite. -logically  affects  our  theoretical   orientations.  "  For 

example,  our  attempts  to  control   all  conditions,  either  by  statistical 

manipulations  or  tight  controls  of  the  situation.,  and  subjects,  are  based  on 

...  \  . 

assumptions  that  sUch  .controls  are  possible  in  the  first  place  and  that 

validity   and.  generalizability   are   possible    outcomes,    thus  explaining 
plausible  defensible  cause  and  effect  reVationships.    An  assumption  is  also 
made  ihat   reactions   of   learners  as  groups  are  indicative  of  the  true  • 
picture  about  individuals  in  that  group.    The  opposite  view  by  those  who 
advocate  naturalistic 'inquiry  is  that  the  assumptions  of  the  reductionists 
are  untenable,  given  the  reality  of  the  interaction  of, social,  contextual,  , 
and  personal   factors  that  affect  learner  response.      Each   approach  to 
inquiry  assumes  its  own  conceptualization  of_the^_nature  of  learners  and; 
becomes- the  starting  point  for  judging,  what  should  be  observed.     On  the. 
other  hand,  both  methods  study  the  effects  of  variable  media  character- 
istics for  determining  optimum  learning  and  conditions.    But  the  extent  to 
which  each  method  takes  into  account  relevant  factors  becomes  an  argumerit  . 
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that  inevitably  leads  to  judging  whether  all  things  needed  for  a  comprehen- 
sive answer  were  included  in  the  research  activity. 

Most  of  us  are  probably  familiar  with  the  conditions  that  have  brought 
about  changes  in  our  views  about  media/learning  relationship  since  the  days 
when  media  were  considered  as  control  mechanisms  for  learner  behavior.  For 
purposes  of  continuity,  let  me  recall  briefly  some  significant  forebears  of 
current  rationales  in  our  field. 

Support  for  a  refined  look  at  media/learning  relationships  came  from  a 
number  of  quarters.  Government  sponsored  research  through  the  National 
Defense  Education  Act  supported  the  traditional  gross  comparative  studies, 
but  also  fostered  investigations  into  the  p/'ogramming  of  instruction,  which 
in  turn  had  an  important  influence  on  the  questioning  of  how  learners 
perceived  and  processed  information.  While  there  was  an  emphasis  in 
programmed  Instruction  research  that  compared  linear  or  branching  methods 
for  presenting  information,  there  was  also,  through  the  so-called  90-90 
criterion  for  the  validation  of  programmed  material ,^ttention  paid  to  the 
reactions  of  individual  learners  to  information  displays. 

A  more  recent  movement,  Trait-Treatment-Interaction  (ATI),  is  based  on 
the  premise  that  having  knowledge  of  the  interactive  effects  of  learner 
aptitudes,  with  instructional  treatments  would  make  it  possible  to  predict 
the  proper  types  of  methods  and  materials  to  insure  desired  learner 
responses.      But  ATI   has  been   criticized  for  basing  measurement  on  a 
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"moment-in-tiine"  in  the  life  of  a  learner  as  a  defensible  basis  fo^  pre- 

'        .  \ 
dieting  future  performance.     The^  continu\ing  problem  not  only  for  ATI  but 

for  all  types  of  research  methodologies  and  theoretical  or'^'^ntations,  is 

that  learners  are  dynamic  individuals  chan^ging  constantly  as  more  infor- 

\ 

mation  is  processed  each,  passing  day.  Wha^  continues  to  cause  idiosyn- 
cratic responses  of  learners  is  ?till  quite  elusive. 

Clearly,  the  major  focus  today  is  upon  the  processes  by  which  a  learner 
perceives  the  environment,,  processes  and  stores,  information,  and  retrieves 
it  for  use  in  communication.  This  emphasis  has  come  about  because  of  the 
recognition  that  learners  are  indeed  idiosyncratic,  that  each  lea  ner  is  a 
product  of  many  experiences  which  compose  a  life,-  and  that  messages  appear 
only  to  be  meaningful  as  each  person  gives  them  meaning.  Relevant  to  this 
refined  look  at  media/learner  relationships,  Glaser  (1976),  almost  a  decade 
ago  proposed  that  there  were  four  components  of  a  psychology  of  instruc- 
tion: the  analysis  of  competent  behavior,  the  , description  of  initial 
states,  the  acquisition  of  competehce,  and  the  assessment  of  instructional 
implementation.  While  all  are  relevant  in  their  own  way  for  determining 
theoretical  bases  for  media  use,  the  last  one— instructional  implementation 
—  is  of  direct  interest.  .  ! 

.       '  '  '  ■ 

There  are  current  theses  about  media  which  . say  that  meciia,  in  fact,,  do 

not  make   any  difference   in   learning— at   least   as  measured   by  typical 

■    *  1  ■ 

research  para'^igms  that  tend  to  manipulate  the  situational  variables  more 
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than  the  intrinsic  attributes  of  the  media  "themselves.  But  there  is  a- 
shift  occurring.  This  shift  is  moving  from  the  more  incidental  role  of 
media  in  instruction  to  a  greater  emphasis  .upon  the  interacting  relation- 
ships among  the  content  and  symbol  systems  of  media  with  specific  learner 
characteristics.  A  case  in  point  is  ,  the  hypothesis  of  Salomon  that  this 
greater  the  similarity  between  the  coding  systems  in  the  message  and  the 
coding  system  in  the  repertoire  of  the  learner,  the  more  likely  learning 

t  r 

will  occur.  Such  a  shift  is  also  seen  in  Olson's  (1972)  theory  of  instruc- 
tional means,  derived  in  part  from  ffruner  and  McLuhan  which  says  that 
technologies  and  techniques  used  with  learners  are  accompanied  by  the 
development  in  learners  of  relevant  cognitive  skills.  v 

What,  then,  are  the  most  prominent  theori.es  that  have  evolved  in. the 
last  decade?  For  current  opinions,  I  am  indebted  to  Clark  and  Salomon 
(1980  fo^  31  chance  to  read  tfie  final  draft  of  a  manuscript  the^  have  pre- 
pared for  the  rThird  Handbook  of  Research  on  Teaching.  Those  of  you  who 
have  studied  the  1974  National  Society  of  the  Study  of  Education. on  Media 
and  Symbols  will  find  some  of  these  theories  familiar. 

The  first  has  to  do  with  the  nature  of  symbol  systems,  the  avenues 
through  which  all  of  us  must  perceive'  our  environments  and  gain  our 
information.  It  offers  a  theoretical  foundation  for  differentiating  among 
symbol  systems  and  may  provide  a  systematic  way  for  defining  those  aspects 
of  symbols  that  may  be  not  only ' pertinent  to  certain  types  of  information. 
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but 'also  that  may  serve  as  devices  by  which  learners  may  process  informa- 
tion.  .1  am  referring  to  Goodman's  Symbol  System  Theory,  discussed  by 
Gardner  and  others  (1974).  ^  "  . 

A  symbol  is  defined  as  anything  that  can  be  used  in  a  referential  way 
and  that  can  be  organized  into  systems.  Goodman  divides,  symbols  into  two 
large  categories  of  being  either  notational  or  non-notational .  By  nota- 
tional,  he  means  ^hat  a  symbol  must  meet  the  criteria  of  being  unambiguous, 
such  as  the  concept  "one  is  always  one";  it  must  be  semantically 
disjointed— that  is,  no  two  characters  can  have  a  common  referent—and  it 
must  have  ^  finite  di^ff erentiation.  For  example,  the  signs  ^or  the  bass  or 
treble  clef  in  musical  notation  are  finite  differentiations  and  remain  so, 
assuming  no  other  meaning.^  Non-notationality,  on  the  other  hand,  suggests 
symbols  that  are  dense,  replete  with  information,  and  subject  to  a  variety 
of  interpretations.  A  picture  may  be  classified  as  nort-notational  because 
it  may  be  interpreted  in  a  variety  of  ways.  There  can,  however,  be  symbols 
within  the  picture  that  can  be  finite  in  their  meaning  and  designation,  and 
hence  notational.  While  this  presentation  is  not  the  place  for  a  detailed 
discussion  of  Goodman's  model,  there  is  a^ additional  model  worth  mention- 
ing which  complements  Goodman's  work.  It  is  also  discussed  in  the  NSSE 
Yearbook.  It  is  Gross's  identification  of  various  information  modes  that 
contain  symbol  systems  peculiar  to'given  sets  or  types  of  information.  The 
modes,  which  he  calls  primary,  are  linguistic,  socio-gestural ,  iconic, 
logico-mathematical,   and  musical.     Each  of  these  categories  provides  a 
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system  for  differentiating  the  specificity  of  certain  symbols.  "  Of  interest 
to  us  is  that  these  may  provide  a  systematic  basis  for  answering  questions 
about  the  types  of  symbols  required  by  learners  vto  acquire  >and  process 
certain  kinds  of  information.  They  may  also  be  usefL{)l  for  determining 
whether  learners  utilize  these  symbols  as  tools  in  their  own  cognitive 
processing. 

Gross  has   also  formulated  two  other  general   symbol  classifications 
'which  utilize  primary  modes  in  idiosyncratic  ways.     One  is  the  derived 
mode,  such  as  ^poetry,  daixe,  and  f  'lm.    The  other  is  the  technical  mode, 
suggesting    the   peculiar    language   of   the   sciences,    engineering,  tech- 
nologies, and  architecture.  ^  ^ 

A  second  prominent  theoretical  formulation  of  current  use  is  that  of 
Olson  (1972,  1974),  referred  to  earlier.  Calling,  his  theory  one  of 
initructionaT  means,  Olson  suggests  two  aspects  of  media  that  affect, 
learning.  One  is  thut  the  content  of  ,a  medium  relates  to  the  knowledge 
acquired.  That  is,  the  content  may  assist  in  the  acquisition  of  rules  and 
principles  that  are  invariant  features  across  different  activities,  a  kind 
of  transfer  of  knowledge  generated  by  the  medium.  The  other  aspect  relates 
to  the  acquisition  of  skills  that  are  required  to  utilize  the  information 
presented  in  the  medium.  The  coding  system  and  means  of  presenting  the 
information  may= become  tools  for  utilizing  similar  coding  systems  or  means. 

Olson  also  suggests  that  there  is  .a  significant  difference  between  an 
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"utterance"  and  "text"  which  have  direct  implications  fo!'  -  r  understanding 
of  the  functions  of  media.  Olson  characterized  an  utteran- '  as  oral  lan- 
guage that  is  flexible,  unspecified,  with  a  low  degree  of  conv^'  penaliza- 
tion, and  that  is  ne'gotiable  in  a  social  vetting.  Written  languaqe.  .i  the 
other  hand,  "demands  precision  and  explic.  -ss  of  meaning.  It  .i-'-  'r.-j. 
maintain  philosophical,  scientific,  analytic  h.  ;; /ledge.  Thus,  a.>  Je^.  ne;  ; 
are  schooled  in  written  language,  they  develon  ■  "kill  and  hab;ti:auion  to 
textual  material,  or  a  literacy  bias,  as  Olson  d;-:.cribes  it.  T;;us,  it  my 
be  that  long  training  and  practice  in  text  materials  may  inhibit  learnirig 
from  other  than  text.  This  may  be  a  partial  explanation  for  the  finding  of 
Guba  when  h-^  observed  the  visual  attention  of  subject?  who  watched  science 
demonstrations  on  television.  At  times  their  eyes  went  out  of  focus' and 
they  tended  to  watch  the  mout!.  of  the  demonstrator  more  often  than  the 
details  of  the  demonstration.  It  may  be  that  we  perpetuate  dependence  upon 
text  by  utilizing  it  continuously  in  our  testing  procedures  and  thus  con- 
dition learners  not  to   bierve  other  forms  of  information. 

The  third  theoretical  model  is  Salomon's  Media  Attribute  Theory  (1979, 
1981),  which  he  has  developed  over  a  number  of  years.  The  thee -y  says,  in 
effect,  that  both  media  and  the  human  mind  employ  symbol  systems  ^or 
acquiring,  storing,  and  manipulating  information.  Also,  he  contends  that 
some  of  the  tools  of  cognition  are  the  consequence  oc  erri^loying  symbols 
that  were  inherent  in  media.  In  essence,  he  has  suggested  a  supplantat- "n 
theory  which  says  that  it  is  possible  for  technological  devices,  such  as.  a 
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zoom  lens,  to  provide  an  observable  analogy  to  the  mental  process  of  pro- 
ceeding from  a  generalization  to  a  pari^icular  and  back  to  a  generalization 
again.  The  use  of  a  zoom  lens  to  assist  -  field--depehdent  students*' to 
observe  details  in  a  picture  is  offered  by  Salomon  as  tentative  evidence 

A  '         0  \  " 

\  ...  . 

of  this  phenomenon.  Clark  (1983)  on  the  other  hahd,  contended  that  zooming 
is  not  a  media  attribute,  but  a  method  for  enlarging  and  focusing. 

In  addition  to  these  three  theories^  there''  is  also  the  current  question 
that  cuts  . across,  all  of  them.  It  is  the  contrn/ersy  aboutxwhethcr  humans 
process  information  through  images  or  propcsitionr..  Those  wh6\support  the 
imaging  Hypothesis  contend  that  a  mental  image  is  analogous  to  t)ie  percep- 
tion of  the  actual  object.  In  the  opposite  camp,  those  who  deny  the  ppssi- 
bility  of  imaging  contend  that  there  is  no  direct  connection  oetween  what 
one  observes  and  the  final  knowledge  acquired,  because  all  stirrjlijs^ 
situations  are  affected  by  beliefs,  goals,  prcvions'^  knc /"'edge,  experience, 
and  emotional  states.  Final  knowledge  is  governed  by  rationality—that  is, 
all  stimuli  are  acted  upon  by  the  learner's  reper^oiro  of  the  mo:nent. 

Also  related  to  these  three  theoretical  positions  is  the  question 
whether  media  attributes  or  codes  are  in  fact  unique  in  conveying  infor- 
mation. Since  learners  acquire  knowledge  through  many  different  forms  of 
media,  there  must  besomething  operating  beyond  the-  hoped-fDr  uniqueness  of 
specific  media.  Researchers  apparently  must  look  tc  the  ccqnitive  pr:- 
cesses  learners  use 'to  manipulate  informatioOj  or  search  for  factors  that 
may  have  nothing  to  do  with  media  directly. 
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There  is  some  evidence  supporting  the  notion  that  factors  other  than 
media  have  more  influence  on  learner  r^esponses  to  media  that  the  element  or 
coding  systems  within  media  themselves.  Clark  and  Salomon  (1984)  suggest 
that  one  relate^'  to  the  effects  of  learner  anticipation  of  madia  in  terms 
of  efforts  that/must  be  invested  in  their  use..  It  appears  that- where  media 
are  perceived  as  critical  to  future  performance,  learners  will  expend  more 
effort.  Where  media  are  perceived  as  entertainment,  less  effort  is 
expended.  Twenty  years  ago  Greenhill  (1967)  pondered  why  television 
instruction  did  not  often  prove  superior  when  compared  with  traditional 
university  instruction.  He  hypothesized'  that  good  television  instruction 
required  less  expenditure  of  effort  by  students;  therefore,  they  put  more 
time  into  traditional  courses  which  were  less  well  presented.  Thus,  tele- 
vision instruction  was  not  given  a  fair  test,  leading  to  the  "no  signifi- 
cant  difference"  conclusion.  ,c 

Clark  (1983)  reviewed  a  number  of  studies  having  to  do  with  student 
effort.  Among  his  findings  was  the  *  phenomenon  of  high-ability  students 
choosing  structured  methods  and  media  because  they  perceived  that  they 
would  have  to  expend  less  ,  effort.  Lower-ability  students,  on  the  other 
hand,  chose  less-structiired  media  and  more  discovery-oriented  methods 
because  they  wished  to  avoid  the  failure  that  may  have  come  from  being 
unable  to  fulfill  the  requirements  of  the  structured  and  directed  si'tua- 
tio'n.  In  a  recent  letter  to  me,  Clark  (11/15/83)  has  this  tc  say:  "I  'have 
arrived  aflb  a  very  reluctant  conclusion  that  media  do  not  contribute  much  to 
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learning  •  •  •  and  only  minimally  to  decoding,    I  do    hink  that  the  symbol 

i 

system  approach  has  promise  for  instructional  design  but  not  much  theoreti- 
cal importance,  •  •  He  thinks  that  media  contribute  only  "indirectly 
through,  variations  in  persistence  which  are  contributed  by  our  subjective 
compressions  of  how  much  effort  is  required  to  learn  from  various  medi?.," 

Where,  then,  are  we  in  our  search  for  theoretical  foundations  that  have 
viability?  I  would  encapsulize  directions  in  the  theoretical  bases  of  our 
research  from  one  of  regarding  the  learner  as  being  reactive  and  under 
stimulus  control,  to  one  in  which  the  learner  is  much  more  a  participant  in 
determining  wHat-i effects  media  have  upon  the  transmission  of  information,  ^ 
upon  learner  perceptions,  and  upon  cognitive  processes  themselves.  It  is^ 
not  only  a  matter  of  how  learners  perceive  the  messages  conveyed  via  media, 
but  also  one  of  discovering  whether  and  how  learners  utilize  the  coding 
systems  of  media  as  tools  for  manipulating  information.  In  essence,  the 
attempt  to  prove  media  utility  is  a  dead  issue,  as  is  the  attempt  to  depend 
upon  gross  comparative  studies  as  sources  for  definitive  answers  about 
media  characteristics  and  their  influences  upon  the  specifics  of  learner 
behavior.    Some  fruitful  questions  to  ask  may  be: 

—  Do  the  coding  systems  of  media  actually  serve  as  tools  for. various 
aspects  of  cognition,  or  do  they  not?     ^»  . 

—  Do  skills  required  for  utilizing  content  and  methodologies  associated 
with  media  become  skills  in  -cognition?  ^ 
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~  What  methods  might  we  generate  to  make  efficient  and  effective 
collaboration  with  learners  in  discovering  the  uniqueness  of  media? 

~  Can  the  inherent  qualities  of  media  and  related  technological  devices 
act  to  supplant  and/or  complement  given  mental  activities? 

—  Are  the  concepts  of  notationality  and  non-notationality  viable  para- 
digms for  determining  the  specific  functions  of  media  coding  systems? 

—  What  methodologies  best  complement  the  uses  of .media? 

~  Are  there  ynique  qualities  of  given  media  that  fft  particular  learning 
needs,,  or  is  it  only  a  case  of  differing  methodologies  that  make  the 
differences  in  learner  responses  to  media? 

~  In  the  final  analysis,  are  learner  attitudes  and  efforts  in  using  media 
as  contended  by  Clark  the  only  evidence  we  can  depend  on  to  account  for 
media  effects? 

-  •  <j 

Turning,  finally  to  ^he' questionnaire,  it  was  devised  by  four  graduate 

student-s  and  myself  as  a  way  of  sampling  the  opinions  of  theoreticians -and 

researchers  in  media.    .The  attempt  was  to  select  fifty  statements  that  . 

seemed  to  appear  in  current  literature  and  did  not  pretend  to  be  exhaustive 

or  foolproof.     While  the  questionnaire  was  titled,  "Theories  About  Media 

and  Learning,"  some  respondents  suggested— and  perhaps  rightly— that  the 

statements  were  really  hypotheses..    The  argument  is  somewhat  semantic  and 

dependent  upon  the  definitional  line  between  a  hypothesis  and  a  theory.  ' 
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All  but  nine  of  the  hundred  persons  who  were  sent  the  questionnaire 
were  on  the  tnembership  list  of  RTD.  Forty-two  returns  were  received  in 
time  for  inclusion  in  calculations.  Since  the  questionnaires  were  anony- 
mous responses,  there  is  no  way  of  knowing  who  were  involved,  with  the  rare 
exception  of  a  signature  or  two  accompanying  a  comment. 

Frequency  data  were  determined^ for . each  of  the  seven  categories  in  the 
"Valid  to  Not  Valid"  scale  and  for  the  choices  of  whether  a  particular, 
statement  was  important  or  not  important  for  reseav^ch  in  our  field.  Means 
and  standard  deviations  were  calculated,  as  well  as  a  correlation  coeffi- 
cient for  the  relationship  between  the  not  important  category  and  each 
statement  frequency  data.  The'  handouts  provide  a  compil^ation  of  the  data 
that  you  may  match  with  a  copy  of  the  questionnaire. 

Looking  first  at  the  statements  that' respondents  regarded. as  not  valid, 
thirteen  had  large  enough  frequency  to  cjuality.  My  intention  is  not  to 
engage  in  a  lengthy  di-scussion  of  these  statements,  but  simply  to  raise 
your  consciousness  of  what  42  colleagues  think. 

Statements  Judged  Not  Valid   ..  \ 

3.  Developing  "literacy"  in  the  interpretation  of  non-verbal  information 
by  learners  is  more  a  matter  of  being  exposed  to  a  wide  variety  of 'non- 
verbal experiences  than  it  is  a  matter  of  being  taught  to  observe 
nuances  in  non-verbal  materials.  *  / 
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7.  Media  are  papable  of  insuring  antigipated  learning  outcomes. 
9.  Media  attributes  affect  learners  in  the  same  way. 

li.  Structuring  media  experiences  insures  common  learning  of  information. 

\    .       '  "  ■  ■  .      ■  ■    .  i 

16.  Random  behavior  in  human  perfprm^ance  is  due  to  the  way  people  interpret 
media.  •     ^  ' 

20.  MultipVe  image  instruction  contributes  to  greater  learning  and  reten-. 
ti on  than  single  image  instruction. 

25.  Each  message  has  a  best  message  form  and  carrier. 

27.T^e  technical  quality  of  the  conveyance  system  does  not  affect  the 
fidelity  of  the  original  message. 

31.  There  is  no  competition  when  similar  information  is  presented  in  two 
media.  ■  / 

36.  The  less  the  information  in  a  medium  is  like  the  "reality"  it  repre- 

/  '  • 

'    sents,  the  1as5  the  student  will  learn  about  reality." 

\ 

42.  Verbal^  memory  and  pictorial  memory  are  independent  of  each  other. 

44.  Recall    of    pictorial    information    requires    verbal    processing  for 
retrieval .  "  .p  ' 

48.  Information  overload  is  essential  to  impress  or  exhilerate  the  learner. 

n 

551 

572 


Theoretical  Bases  for  Research  in  Media 

I-  .17 

Statements  Judged  Valid 

At  the  opposite  ,end  of  the  scale,  there  were  fourteen  staternents  that 
were  regarded  by  the  respondents  as  valid  and  important  for  research.  >  Each 
of  these  had  significant  correlation  coefficients. 

2.  The  greater  the  match  between  learner  experience  and  media  attributes, 
the  greater  the  likelihood  of  learner  r^cceptance  of  media  content.  . 

•'■         '  ■  ^       '  ■        .  ■'  / 

4l  Overt/covert  responses  of  learners  to  "media"  experiences  are  more 
•   likely    to    result    in    greater    memory    storage    than  covert/passive- 
:    responses.  ' 

5.  The  more  a  symbol  system  matches  the  critical  features  of  an  idea  or, 
event,  the  more  appropriate  it  is.'  *  -  '  / 

.  f  .         ■  .        ■  I 

\       ■       ■     ■  ■  ^.  -      '      ■  / 

6.  Fitness  o;    a  message  form"  depends  upon  the  characteristics  of  the 
!    information.  .  / 

1^.  Negative  teacher  attitude  towd-^d  a  media  presentation  creates  negative 
student  attitudes.  / 

Presenting  various  forms  of  media  provides  the  greatest  compatibility 

-  ■  ■        !  /  - 

with  the  nature  of  idiosyncratic  brains.  / 

/     •        ■  /  ' 

ig.  It'^is  critical  for  effective  media  usage  to  know  /the  range  of  coding 
elements  available  in; each  learner's  repertoire.   /  / 


/  V 
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17.  Sequential  build-up  of  illustrations  leads  to  better -understanding, 
19.  Excessive  detail  interferes  with  transmission  of  intended  information. 
21.  The  advantage  of  visual   over  auditory  materials  increases  /dr  ^more 

r 

'difficult  materials.  !  ^ 

24.  The  more  similar  the  coding  schemes  in  the  teacher's  and  student's 
repertoires  the  greater  the  possibility  for  learning. to  take  place.  .. 

26.  Messages,  message  forms,  and  conveyance  systems  interact  to  convey  the 
intended  message. 

29.  Cultural  differences  affect  learner  interpretations  of  media. 

■     .  ■    /  ' 

34.  Learners  have  difficulty  discriminating  iDetween  subjectivity  and  objec- 

"* 

tivity  in  their  interpretaticvn  of  messages. 

It  is  evident  from  the  queTtionnaire  that  the  largest  number  of  state- 
ments refer  to  media  as  instruments  that  affect  learner  performance^.  Only 
one  in  the  not-valid  category,  number,  |6j  may  be  consonant  with  Clark's 
views  that  there  are-.f actors,  other  than  media  characteristics,  that  affect" 
learner  responses.  Most  of  the  statements  that  were  regarded  as  valid  and^ 
important  for  research  followed  the  research  paradigm  which  is  looking  for 
ajnatch  between  the  coding,  critical  elements  in  media,  and  the  repertoire 
of  the  learner.  .  - 

(89)H  .  ^    .  i 
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Appendix 

1.  Questionnaire 

2.  Data  for  42  respondents  to  questionnaire 
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THEORIES  ABOUT  MEDIA  AND  LEARNING 


ON-         NOT  NOT 
IVALID     DECIDED  VALID  |  I^:PORTANT  IMPORTAI 


1.  Learning  is  enhanced  when  the 
student  controls  at  least  part  of  the 
presentation  of  information. 

2.  The  greater  the  match  between 
learner  experiences  and  media  attri- 
butes, the  greater  the  likelihood  of 
learner  acceptance  of  media  content. 

3.  Developing  "literacy"  in  the  inter- 
pretatic:.;  of  non-verbal  information  by 
learners  is  more  a  matter  of  being 
e'xposed  to  a  wide  variety  of  non- 
verbal e:<periences  than  it  is  a  matter 
of  being  taught  to  observe  nuances  in 
non-verbal  materials.. 

4.  Overt/active  responses  of  learners 
to  "media"  experiences  are  more  likely 
to  result  in  greater  memory  storage 
than  covert/passive  responses. 

5.  The  more  a  symbol  system  matches 
the  criterial  features  of  an  idea  or 
event,  the  more  appropriate  it  is. 

6.  Fitness  of  a  message  form  depends 
upon  the  characteristics  of  the  infor- 
mation. 

7.  Media    are    capable    of  insuring 
anticipated  learning  outcomes-. 

8.  Media  related  to  similar  informa- 
■  tion  converge  knowledge  and  diverge  as 

to    skills     required    by    learners  to 
process  different  media. 

9.  Media  attributes  affect  learners  in 
the  same  way.  - 

10.  Certain  media  may  accelerate 
learning  by  providing  tools  or  analogs 
for  mental  activities. 

11.  Structuring  media  experiences  in- 
sures common  learning  of  information. 

12.  Negative  teacher  attitlade  toward  a 
media  presentation  creates  negative 
student  attitudes. 

13.  Teacher    follow-up    to    a  media 
Dresentatioij  affects  how  much  students  j,^ 
^-^arn  from  it.  i>*»i<^ 
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UN-         NOT  NOT 
IVALID     DEC^l  '  T)  VALID  |  IMPORTANT  IMPORTAK 


14.  Presenting  various  forms  of  media 
provides  the  greatest  compatibility 
with  the  nature  of  idiosyncratic 
brains.  — ' — ' 

15.  It  is  critical  for  effective  media 
usage  to  know  the  range  of  coding 
elements  available  in  each  learner's 
repertoire..  ^  — I — I 

16.  Random  behavior  in  human  perfor- 
mance is  due  to  the  way  people  inter- 
pret media.  — I — 

17.  Sequential  build-up  of  illustra- 
tions leads  to  better  understanding.      — I — 

18.  Reinforcing  questions  dispersed 
through  instructional  material  are  not 
equally  effective  for  all  learners.  — 

19.  Excessive  detail  interferes  with 
transmission  of  intended  information.     — I — 

20.  Multiple  image  instruction  contri- 
butes   to  greater  learninq  and  reten- 

:tion  than  single  image  instruction.        — I — 

21.  The  advantage  of  visual  over 
auditory  materials  increases  for  more 
difficult  material.  — I — 

22.  Visual  information  is  remembered 
longer  than  aural  information.  — I — 

23.  Gender  differences  can  be  expected 
among  learner  responses  to  media.         .  , —  I — 

24.  The  more  similar  the  coding 
schemes  in  the  teacher's  and  student's 
repertoire  the  greater  the  possibility 

for  learning  to  take  place.  '    — I — 

25.  Each  message  has  a  best  message 

form  and  carrier.  — I — 

26.  Messages^  message  forms^  and  con- 
veyance systems  interact  to  convey  the 
intended  message.  — " — 

27.  The  technical  quality  of  the 
conveyance  system  does  not  affect  the 
fidelity  of  the  original  message.  — I — 

28.  Media  in  combination  are  superior 

to  a  single  mediurov  ggg   — 1 — 
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ON-        NOT  NOT 
I VALID     DECIDED  VALID | IMPORTANT  IMPORT 


29.  Cultural  differences  affect 
learner  interpretations  of  media. 

30.  Integrated  code  strategies  enhance 
acquisition  and  retrieval  of  concepts. 

31.  There  is  no  competition  when 
similar  information  is  presented  in 
two  media. 


I_I_L 


32.  Instructional  visuals  for  use 
with  highly  anxious  students  should 
contain    critical  information  salient 

to  the  students.   I  I  I  I  I  L 

33.  Both  author  and  audience  contri- 
bute to  a  message.   F  I  I  I  I  L 

34.  Learners  have  difficulty  discrimi- 
nating between  subjectivity  and  objec- 
tivity     in    their    interpretation  of 

messages.   I  I  I  I  I  L 

35.  Separate  information  received  via 
separate  media  tends  to  be  processed 
independently,      but    integrated  with 

difficulty.  "   I  1^1  I  I  I. 

36.  The  less  the  information  in  a 
medium  is  like  the  "reality"  it  repre- 
sents, the  less  the  student  wij-l  learn 

about  "reality."   I  I  I  I  I  L 

37.  Irrelevant  cues  in  message  forms 

interfere  with  learning.   I  I  I  I  I  L 

38.  To     store  information,  learners 

filter  out  irrevelant  cues.   I  I  I  I  I  L 

39.  Learner  differences  account  for 
varying     responses  to  media  more  than 

differences  among  media  attributes.   I  I  I  I  I  I. 

40.  Instructional  procedures  which 
complement  media  usage  are  less 
beneficial     to  high    ability  students 

than  to  low  ability  students.   I  I  |_|  h  |_ 

41.  High  ability  learneis,  more  than 
low  ability  learners,  _ need  high 
density     and    complex    information  to 

challenge  their  abilities.   I  I  !  1  I  L 

42.  Verbal      memory    and  pictorial 

memory  are  independent  of  each  other.   |  I  I  \  I  fl 

o  "559  . 
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43.  Verbal  interference  conflicts  less  I 
with    pictorial  information  than    with  I 

verbal  information.   I  I —  I — I —  I — I —  1  

44.  Recall  of  pictorial  information  I 
requires        verbal      processing        for  I 

retrieval.  — I — I — I —  I — I — I —  '  

45.  The  human  perceptual  system  de-  I 
mands     sufficient    fixation    time     for  I 

detail  to  be  observed.   I  I — I — I — I — I — I  '  

46.  Fixation  for  pictorial  material  I 
requires     less    time  than    for    verbal  I 

materials.  — I — I — I— I — I — I —  ^  

47.  The  amount  of  information  an  I 
observer     can    absorb  depends    on    the  I 

level  of  analysis  required.  _   I  I  I — 1 — I — I — I  —I  

48.  Information  overload  is    essential  I 

to  impress  or  exhilerate  the  learner.   I — I — I — I — I — I —  ^1  

49.  Redundant  information  in    multi-  I  - 
image    presentations  sTiortens  fixation 

time  for  observing  detail.  -     — I — I — I — I — I — I —  '  

50.  The  perception  and  storage  of  .  ^1 
information  is  a  dual    coding    process  -  I 

(images  and  symbols).  — I — 1 — I — I — I — 1 — «  «  

P/.ease    use  the  space  below  to  add  any  theories  which  you  think  might  h 
been  overlooked  in  this  brief  survey. 
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INTEODUCTION 

lecnaoio qicai  advances  ana  nev  devices  have  teen  iu- 
troducGd  to  t  ne  world  cciujiurAity   ctt  au  ever  increasiiiq  rate 
since  the  turn  of  tlie  cexirury.     In  oraer  to  properly  under- 
stand aiiu  operate  the:3e  new  teca uolcqies ,  personnex  traininq 
uas  'becOiie  increasinqly  iuportant.     within  xiiis  dcmain^  a 
syoteiiiu.ti  c  approach  oi  monitoring  the  ei  lecti  veness  of  in- 
structional trainanq  has  been  developed  termed  rormative 
evaluation . 

Leslie  oriqqs    ( 1 'j74)    defined  icrnative  evaluation  as 
*'tryouti=  ana  revisions  cf  couiponents  of  an  instructional 
sysreia  uefore  operational  use.     It  ircludes  tcyours  of  mate- 
rials With  individual  learners  and  sucll  qroups^  as  well  as 
with  entire  classes  an  the  scaool  sittation"    (Briqqs  #  1974  ^ 
p .  288)  . 

The   application  ot  rormative  tiValuation  procedures  has 
qained  increasinq  support  in  the  educational  coamunity^ 
provoking  an  observable   trena   toinard  the  use  of  this  tech- 
nique* reflected  in  eventii  sucn  as: 

!•     The  incor pora ticn  of  formati\e  evaluation  as  a  main 
stop  in  aiaost  all  mouels  used  for  the  systematic  design  of 
instruction    [aranson,  Raynor*  Cue*  Tuicau*  Kinq*  and  rlannutt# 
1^)75;   liriggs^    1':^70;   iSriqqs  and  Guqne,    1S7U;   Dick  and  Carey* 
1^7o), 
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2.  liid  abuudance  cx  arricifes  and  books  pxroposinq  dif- 
rerinq  aetuods  tor  tormatiVGiy  evaluatitg  instr uctioaal 
udteLiais    (Abedor,    1^72;  BdRor,    1974;   houich,   1974;  Briqqs 
and  Gaqne,   1974;  Dick. and  Carey,   1978:  Kaufiaan  and  laomas, 
1980  ;  Sdnaers  and  Cuni^inguam,  1970  ;   Sinqer  and  Dick,  1974). 

3.  Increasiuq  interest  in  ceportinq  evaluation  stud- 
ies,' thoir  stra  teqies  a  nd  resuits   (Abedor,    1972  ;  Eaker, 
1974;  Bank  anu  Fink,  1976;  Dick,   1968;  Lawson,    1974;  Liqat 
and  heynolds,    1  972;  Lindvail  and  Cox,   1t^70;   darkle,    19b7)  . 

laportaut  early  researchers   in  tie  iistcry  ox  ed- 
ucatiunax  teciincioqy,   such  as  Dale,   Kinder,    Hooan ,  Lazar- 
xeid,   Luuisdaine  and  Carpenter  "unani  incusl  y  supported  the 
value  ox  and  need  for  evaluation  during  productioii  of  in- 
structional materials"    (Caiflbre,    197b,   p.  2). 

in  a  study  conducted  in   1^74,   out  ox  "JOCOOO  commer- 
cial instructional  inaterials  available  at  that  tiaa,  only 
aDout  3,000,  or  one  percent,   « deEonst i ated  one  or  more  of 
the  attributes  of  empirically  developed  axd  ioproved  nate- 
rial'"    {Kcuoski,    1974,    p.   357)  . 

m  Pophaui's  view   (1970)  ,   tne  research  relatea  to  cur- 
riculum developiaent  suffered  fxoa  sexicu£  dericiences.  He' 
indicated,  neither  improveaent  of  natexials  Daseu  on  em- 
pirical data,  nor  the  manner  in  wnicn  revisions  could  be 
.uade  have  been  clearly  demonstrated. 
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L:esj.de:3  iiuiited  eaipiricdi  evidence  £uppoi:tiiiq  formative 
evaludti.an  iQodeis  -  otner  probleuiS  exist  that  act  as  a  con- 
stL'dir*t  tc  its  uisaqe, 

1.     Taere  is   a  lack  of  accepted  cefiDiticns   (BaKer  and 
Alkiiu    1^73;   Saaders  and  Cunuiiiqiian:^    1S7C)  . 

2m     Duriiiq'  the  instructional  aesiqa  process^  foriuative 
evdi'Udtion  is  atttuipted   priiuarxlv  afjttr  the  prototype  lias 
tDeoh  ueveiopeu.     Ihere  is  oxteiisivci  diialysis;   however,  there 
dre  Qsuaily  no  cnecks   tor  validity^   xeJiafcilxty,    or  suit- 
ability ox  tae  product. 

J,     Gcpnart   (l!J7t>)    inaicatcu  that  aithouqu  variouis 
luodelo  ^2ii3t,   one  st^p  invdriaoxy  Sbems  to  i^e  uissinq.  l*his 
refers  to   what  to   do  with  the  data  aiier  it  has  been 

COllcCttiU. 

i|,     .'lest  ox  the  for     ti  ve  e  val  ud  tion  moa^is  currently 
utxii2eQ  have  not   teen  ciopxr ically  tested   Irtartcili,    1913)  . 
The  proDxeu  ox  xoxiuative  evaluation  acdeis  which  cire  lacicirq 
empirical  support  nas  been  discussed  by  Smith  and  ilurray 
(  1975),   who  iijdicated  that:     "tnero  is  little  or  no  informa- 
tion dbout  the  relative  efxiciency  ox  alternative  evaluaticn 
Techniques  anu,    therefore,    there  is  a  Xieed  for  evaluation 
resodrch  on  the  laudels  theaiselves"   (p.  5). 

li  recent  articles  oy  David  Fcruai  stdtea   that  "in  the 
xield  ox  trdininq,    evaluation  is  rarely  ccnaucted"  (Avcrsa 
ana  Fcruian,   197d,    p.    lo-lo)  .     de  ajiso  stated  that  there  were 
three  reasons  for  tiixo  state  ox  aifaixs: 
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1,  Unlike  uducation,    a  qreet  deal  of  traxainq 
occurs  ill  tht;  private,  ds  opposed  to  the  public  sector. 
Sinc3  the  qov  era  meiit  and  puDlic  lou  i.da  txons  are  not 
oupportiixq  tiies*=  traiuinq  pioqraiDS,  tliev  cduuot  mandate 
evaiuat-ions, 

2,  Tuere-  IS  a  qeiierax  feelinq  that,  educatioiiax 
merhous  are  not  often  weii-suited  to  the  real,  every- 
day^  outcoae-oriented  world  of  lusiness.     These  people 
tend  to  uistruiDt  educationai  methoas  and  techniques 
borrowed  without  adaption  and  revision;   tney  wajt 
traininq  evaluaLion  to  devcxop  a  character  ut  ito  own* 

3,  The  field   of  traiuinq  is  in  a  i^tate  of  tremen- 
dous qrokth  and  development.     The  demand  for  traininq 
is  qreat,  and  trainers  are   thinkinq  more  aiout  develop- 
inq  their  next  proiect  as  opposed  tc  evdluatinq  and 
iuiprcvinq  their  present  one. 


Sta  tejnent_of  __tae_Prcbl6m 
Ihere  was  a  need  icr  the  deve-Lopuent  or   a  foruiative 
evaluation  paradiqni  qleanea  froui  tie  lilcrature   whicu  would 
be  applicable  to  the  educational,  as  vel^  as  the  industrial 
settiuq,   and  wcula  pruviae  information  for  the  advancement 
or  knowxedqe  about  tne  instructional  rrccess. 

^  u  r  p.ps  e_  o  r  _  t  n  e_  S  t  jjdj 
The  purpose  of  tnis  study ^   therefore,   was  to: 
1,      invGstiqate  the  appropriate  evaluctici  literature  and 
develop  a  xoruiat-Lve  evaluation  inodel.     2,     Invastiqate  the 
fornative  evaluation  procedures  utili2ed  by  Advanced 
Systeuis,   Incorporated  and  develop  a  acdel  based  upon  these 
proc^dur^s.     J.  Cciupare  ana  contrast  the  two  resultant  laod- 
uis  rcr  ccniiuo  nalities  and  differences. 
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i  6  s  6  ar  c  i  i_  ^  a  e  d  1 1  cjc  s 

One   Q:eaD:3  ci  invtis tiqat         thus   particular  i^oue  oi 
tneory  versus  practice  was  to  rocuii  upcii  one  success xui 
prouucfci:  ot  "craiaiaq  iuareriais   lAdvanced  Syscems*   Iiic.)#  in 
an  eirort  to  uiocover  how  cioseiy  the  fcricative  evaluation 
tecnniques  arc  Etiatea  to  actual  standards  preset  by  the 
trai^iina  corporation.     Ihrouqh  detaiied  analysis  of  actual 
procedures  in   a  aiaior  production  onrit7#   some  insiqnt  into 
the  guesticn  or  rcrniativo  ^  valuation  procedurc;s  was  qleaned. 

In  oruer  to  coaplete  tiiis  task,   trie  researcher  answered 
jlour  speciric  questions: 

1.  yihat  is  the  cUiLront  state  or  foruiative  evaluation 
theory  as  developed  in  past  ana  present  professional 
i.iter atur 

2.  What  is  the  procedure   ot  loraiativt  evaluation  uti- 
lized by  Acvanceu  Systeirs,  Inc.,  ana   ^hat  are  the  results  cf 
this  procedur  e? 

3.  What  is  the  relationship  benieen  existinq  formative 
evaluation  theory  and  fcruiative  evaluation  of  training  mate- 
rials and  proqraus  as  reflected  in  the  cccparison  of    (1)  ard 
U)? 

4.  What  conclusions  can  be  reached  as  a  result  of  this 
coaipaiiscn? 
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^(  es  ear  ch_,  P  r  o  c  d  u  r  e  _^au6  _  pQ  s  i^g  a 
la  order  to  complete  rhe  precedirq  tasks,  a  case  stud  y 
approach   uac  utili2ed,  ccuibiiied   »i  ui  au  exteasive  rcjview  of 
rlie  Ixter arur <i .     lae  resGarcn  was  divided  intc  twc  distiact 
phases,     The  first  phase  involved  a  litGiature  review  or 
current  rormative  evaluation  proceauies  and  theory.  An 
attempt  was  iaauG  to  ideatiiy  noted  authorities  through  in— 
dices,  computer  aata  uases,  uiulicqr a  phic  data,  and  priinarv 
as  well  as  secondary  sources  relateu  to  the  problem.  After 
sufticient  uata  was  qathercd   usinq  these  tools,  a  formative 
evaludtica  luocel  was  qenerateu  bas£:d   upon  the  qeaeral  state 
or  the  alt  derived  from  the  literature.     This  model  served 
as  a  Dasis  of  coiupariiion  for  the  procedures  and  resultaat 
utouejL  utilized  uy  Advaacea  Systems,   lac.     This  was  accom- 
plisaeu  tarouqh  a   uescriptica  or   the   systiSius  in  use  today. 
Folio  •rfinq  this  uescription,  the  two  a  j.  preaches  were  analyzed 
lor  similarities  and/or   differences,     ihe  final  end  proauct 
of  this  particular  phase  was  a  mouei  tased  on  existing 
tneory,  saitalle  for  comparison  with  £   nccel  derived:  from 
procedures  used  by  Aavaaced  Systems,  Inc. 

'ihe  second  piias^:;  of  tae  research  consisted  of  qatherinq 
data  throuqh  observation  of  evaiuaticr  p iccedure  and  throuqh 
tsxtcasive  visitation  aad  an  in-nouse  iiurvey  of  A51  employees 
involvea  in  the  product  development  process.  Initially,  any 
printed  uateriai  relevant  to  product  ce veiopiiient  and.  partic-- 
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uiariy  formative  evaluation  was  oearcled  cun  and  aiiaj-Vzed. 
An   in-nouiic  survey  va;^  distributc^d  to  further  verity  these 
proceuures  and  to  ascertain  Gupioyee  attitudes  in  mqara  tc 
the  product  developfflent  pruc3ii:3. 

Mckgrouna 

•  Until  Internat  .onal  businoss  I^achines    IIBi^l)  was 

t-he  domziidiit  force  in  the  traininq  ct   employees  in  the  uti-- 
xizaticn  cl  ccaiputer  tecnnoloqy,    simply  hecause  tney  pro- 
vided free  trainluq  wirn  the   purchase  of  a  computer.  Some— 
riiiiG  later,   corporations  were  required  tc  pay  for  traxninq, 
and  at  tnis  iuncture,    three  individuais  leix  IBI-l  to  form 
their  own  corporation  tc  provide   traaninq  ±ii  data 
procussinq. 

The  initial  metnod  of  instructioi.  was  stand-up  lecrure. 
The  three  individuals  were  iiitriquea  tv  video,   and  soon 
beqan  to  videotape  their  Instruction  and  sell  rheir 
videotapes. 

In   ^^^0g   the  corporation  was  nameu  Advanced  Systems, 
incorporated,  which  rhen  provided  tralninq  by  vldeotapinq 
stanu-up  lectures   with  tne  support  of  IBK  tralninq  manuals, 
From    1970-1:^73,   Advanced  Systems,   Inc.,  developed  an  ap- 
proach to  Instruction  that  produced  a  pacftLaqed  product:  a 
staqea  presentation  supportea  by  textual  materials  incxudinq 
illustrations,   exercises,  perf orirarce   cfciectives  and  sumnia- 
tive  evaluation    (liestqaard,    li:Jdl)  • 
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in   1^75^  kSI  qroi:i^i:ia  iS^OOO^OOU,  eiupioyed  250  person- 
nel^  Uiid  grew  to  14  uomestic  a:^  veil  as  7  foreiqn  ofiices. 
in  IdbO^   Abi  grossed       li,  000,  OOU ,   euiplcyea  400  personaei  ana 
had  2b  uoijcstic  otfices  and  32  Lorciqn  offices   (Aiiiiudi  iie- 
port,    1980) • 

Iiie  reasons  for  tiiis  growth  rate  were  thraefcid: 
1.   I'he  resait  of  a  quality  co:irLci  pxcc€ss.     2.     A  tightening 
up  of  student  evaluation  pioceuurGs,     j,     Iiapro veiaent  in 
iUiioraation  presentation  techniques^  including  video  script-- 
xnq,  frout-end  azialysis,   instruct icna J  design  and  instruct 
tioaai  pacKaqing   (V^estqaara,    Ij^bl)  • 


The  models  ror  evaluation  uhich  kere  aescriLed  differed 
rroiL  descriptions  of  actual  evaluatiors  in  the  foxlowina 
ways:     no   actual  yroqrain,  curriculum  cr  irateriaJ.  were 
evaluateu   m  the  model;    no  speciiic  ccxtents,  situations,  cr 
contexts  liere  considered  and  tne  level  of  generality  was 
high;   generally^  no  specific  instruments,  aesigns,  or  mecha- 
nisms for  data  collection,  analysis,   etc.,  were  considered; 
tne  specie!  pronlems  which  arose  in  a  particular  study  could 
not  approacned  in  the  evaluation  model.     There  ^ere, 
however,  important  ways  m  whicn  the  evaluation  model  repre- 
sented the  actual  evaluation  stuaies  bhich  it  modelled:  the 
stages  and  components  or  the  actual  evaluation  were  ac- 
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curatcxy  reiioctcid  i:i  the  luoaui;    tne   types  or  r feiatioiiSiiips 
and  data  which  were  analyzed  m  tiie  evcluatiou  Vieie  care- 
fully represeLtv3d  in  the  uioael;    the  q^Deral  plan  and  strat- 
eqy  or  cvaiuaticii  which   were  usod  in   the  study  can  be 
clearly  portrayed  in  the  oiodcx. 

t  omp'dri30ii_-_E  vd  laa  tio^ 

Eleven  evaludxion  aesiqu  syst^i^a   Vcze  presented  in 
UGtaxl  caveriuq  the  aiid-1960's  tc  rhe   prbsent.     For  purposes 
or   the  research,   xt  was  viral  to  estatlisu  taeir  sim- 
ilariT,i^s  and  airfereiices  by  coiuparinq  and  coifloiniiAq  rhe 
various  desiqns  and  staqes  into  a  sircle  ccwprehensi ve  de- 
sxqn, 

Th_e_ConLDin  eQ._Ed 

The  dissertation  w ds  a  discussicr  ci  xorcative  evalua- 
tion in  three  domains;  eaucation,   iiixlitary  trairiinq  and 
industrial  .traininq,     Ihe  next  seqment  of  the  discussion  will 
consist  of  an  outline  coinbininq  the  thre€  areas^    faith  as- 
sistance beinq  provided  in  the  luent ix ication  or  contrx- 
butions  by  ''piacinq  an    'E^  for  eaucation  #  for  indus- 

try/iDXlxtary ,  or  ' EI  •  f  cr  mutual  cont  r il: utions  after  tne 
item  or  entry"    (Barnuu^  1^:^79,  p.    150).     Tne  entire  outline 
lor  the  evaluation  procedure  is  as  rcJlows: 
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I.  Anaiyai^  or  2\^ciiuaxion  heq uir cmeuts 
A.  Dciina  dxid  uezjcrile  pxcLleic  IE) 
d.     Analyze  cVdiuation  setting  (E) 

1,  weea:=  a:5Sossment  (Z) 

2,  Pocuii  evaluation  II) 

J,     Idcntixy  decision-ruakiuq  levelis  (E) 

4.  Ideutity   goals  IL) 

5.  lacUtiiy   general  picqiam  components  IE) 

J. 

6.  Identify  what  is  versus  what  should  be  (E) 

7.  De.jci  ibe  packaqe  ccaiponen ts  (E) 
C.     Pj.un  the  evaluation  activixies  (E) 

1.  Evaluate  neeas  (E) 

2.  Prelect  decision  altexnacives  (E) 
J,     Dexine  decision  criteria  (E) 

4.  Dexine  policies  (ii) 

5.  Identify  the  xcixoviiiq:  (E) 

a.  Longituduual  effects  (E) 

b.  hiqh  payoxf  txcr:=actions  (E) 

c.  Entry  level  tetavicr  and 
characteristics   ( E) 

6.  Prioritise  neea£  ]E) 

/   ?•     Select  needs  xor  acticn  IE) 
d.     Abstract  proiect  (E) 
9»     Dete  rjiiine  intents  x  row     •(  I) 
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a.  Eia 

b.  Dtsxqnecs  H) 

c.  Developers  (1) 

10.     Andiyze   the  uraiiiinq  ^uvxioament  (I) 
Desiaaiaq  the  Evdluurion  Svsten: 

A,  Identify   evaJuatioii  ol-i€ctives  in  terais  of: 
!•     Aadiei.ces  (Z) 

2.     Eaucational  piiilosophy  (E) 
J.      LecisioDS  Ir.) 

4.  Satiect  matt^i:  (li) 

5.  Rationales  (E) 

6.  Staff  dims  IE) 

B.  Perform  a  task  analysis  ct  objectives  II) 

1.  Sujjtasks  into  pertcrmance  objectives  (I) 

2.  Criteiion  -LteiuS  tor  eacu  objective  (I) 

3.  Course  final  exam  (I) 

C»     constr act  course  evalu aticn  Instruments  (I) 

D.  Deterjiine  curriculuio  outline  11) 

E.  Sequence   onjectives  11) 

i\     Select  instructional  u ct e riaxs   (I ) 
G.     DetieriEine  terminal  outc ernes  (1) 
d.     Detericira  information  staqes    ( E) 
1  •  CollecLion 

2.  Or  ganiz  at  ion   (  E) 

3.  Andj-vsis  (El) 

4.  Keportrnq  IE) 
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I.     DNateruixnc  oCdtisricai  cetliOd  (I) 

1 .  D esc  ripti  ve     ta  ti  i=  tics  (I) 

2.  Praaicrive  statistics  (I) 

3.  AIJOVA  or   Ai^CO  VA  II) 

U,     Canonical  cor r elat i c n  fl) 

3.  Iluitiple  u-LSc  ri  minant  anaJ-ysis  (I) 

6.  Path  aaalvtic  metncdcloqy  (I) 

7.  Nou-parametric  sratiatics  (I) 

J.     Anaiyze  cbiectives  ana  iuforiuarion  (E) 

1.  Logical  analyses  |£) 

2.  Euipirical  auaxyses  (E) 
J.     Prerequi  si  tes  IE) 

4.  ^leasuriijq  instruments  IE) 

A,      ijevelop  instructional  strategy  (i;) 
L.     Detacfliine  *'niqii  and  lov  fidej-icy" 

transactions  (1) 
i1.      Prepare  first  ciratt  of  11) 

1,  Script  (I) 

2.  SketCnc;S  II) 

J*     story  hoar  a   U)  I 
4,     Materials   (I)  j' 
III.     Implciiifcritinq  the  Evaluation  Lesiqn  I 
A.      Determine  evaluarion  d i ireii sions  (1) 
b,     Review  prior  to  evaluation  (I) 
C  •     C  o  n  d  uc  t  s  c  l£-e  va  iua  tion  ot  uareriai  (Jl) 

! 
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Lvalaatt:  loaqh  draft  ct   aaterial  (I) 

Provide  txp2rt  appraisal  (I) 

Coi3pl;j  te  mteradi  review  (I) 

Dciv  eiup  natural  laiiquaq  €  questions  11) 

Check  ^valaatioa  aesiqii  for: 

1.  Pervasi  ve  lita^Do  IE) 

2.  iteli  ability    ( E) 

3.  Validity  (2) 

^.     Cxedii;iiity  ( E) 
5,     Tiiiieliness  (B) 

/idmiaiiiter  initial  evaluation  (E'l) 

1.  Inai vaaual  trial   (one-to-one)  (EI) 

2.  Pilot  test  IE) 

3.  Form  ative  interin;  [E) 
Eevisi^  and  recyclti  (EI) 
conduct  qroup  trial  (il) 
revise  and  recycle  (EI) 
Field  test  (HI) 

1.  Formative   product  (E) 

2.  Goal  rr^e  (E) 
Revise  (E) 

Pr  epar     final  f orra 

1.  Scripts  (I) 

2.  Srcryjjoard  (I) 

3.  VioUalS  ID 

a.     daster  rape  ( i) 
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p.     Opordtioiiai  ti^yout  (I) 

V.     Analyze  evaiuatioL  date  (£) 

1.  PruqidC  curcumes  (i:) 

2.  Ra  la  tionsai  pii  and  indicators  (E) 

3.  Ju  dqeoients  (£) 

4.  Obiectiv  €i>  met  IE) 

I  5.      Unexpected  resultis    (£ ) 

6.     Utixization  pxaa  (I) 
h,     Hcvi^e  as  nocessaiy  -  Jcr.c  tern:  (El) 
Tae  final  xxowchart  des  iqn  representative  of  rhe 
svaiuatiori  process^  tina  based   apan  tne  cutiiue^  is  presented 
in   riqur3s   ^,   2,  ana  J. 

^u.iuma  r_y 

Sevi^ral  evuiua-cioa  sysreius  representative  of  the  educa- 
tional^ industrial  ana  lailxtary  donairs  -were  presented 
in  qrear  detail.     Witair  each  or   the   \arious  domains^  the 
inaivxaual  schema tas  of  evaluation  were  analyzed  for  consist- 
ent and  unique  characteristics  that  were  userul  in  tne 
uevelcpuient  ol  a  coiapre  hensi ve  evaluation  system. 

The  final  evaruaricn  systeiu  was  usee  to  analyze  tne 
rnstructJLonal  design  and  evaluatxot  pxccess  used  at  Advanced 
Systems^  In corpora  ted • 

A  brier  history  of  the  ASl  corporation   ^as  aelineared 
in  tno  injiriax  segment  ui  rne  di  <s ert a t icn.     Tnis  data   was  de- 
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ANALYSIS  OF  EVALUATION  REQUIRE^^IENTS 


Evaluation  Problem 


Describe  evaluation 
problem 


Analysis  of  Evaluation  Setting; 

needs  assessment 

focus  evaluation 

identify  decision-making  levels 

identify  goals 

identify  general 

program  components 
identify  what  is  versus 

what  should  be 
describe  package  components 


Plan  the  Evaluation  Activities 

evaluate  needs 

project  decision  alternatives 

develop  decision  criteria 

define  policies 

Identify  the  following: 

longitudinal  effects 

high  payoff  transactions 

.  entry  level  behavior  and 

characteristics 

prioritize  need 

select  needs  for  action 

abstract  project 

Determine  intents  from 

 > 

planners 

designers 

developers 

analyze  the  training  environment 

Define  evaluation 
Droblem 


BOO 


FROM  AIJALYSIS  PHASE 


DESIGN  OF  THE  EVALUATION  SYSTD4 


Identify  evaluation 
o'b.lectives 

Audiences 

Educational  philosophy 

Decisions 

Subject  matter 

Rationales 

Staff  aims 


Determine  terminal 
outcomes 


Task  AncLlysis 

Subtasks  into 

performance  objectives 
Criterion  items 
Course  final  exam 


Construct  course 
evaluation  instrument 

 ► 

Determine  curriculum 
outline 

,  1 

Seouence  objectives 

 h 

Select  instructional 
materials 

Determine  statistical 
method 

descriptive 
predictive 
ATIOVA  or  ANCOVA 
canonical  correlation 
multiple  discriminant 
path  analytic 
nonparametric 


Determine  information 
stages 

collection 
organization 
attialysis 
reporting 
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PRE-EVALUATION  ACTIVITIES 


Determine 

Review 

w 

Evaluation 

prior  to 

dimensions 

evaluation 

N  

Conduct  the  followine;: 


Self  evalu- 
ation of 
material 

 ► 

Roup;h  draft 
of  material 

Expert 
ApDraisal 



Complete 
internal 
review 

Develop 
natural 
language 
questions 


Check  evaluation  desif^n 
criteria  for: 

pervasiveness 

reliability 

validity 

credibility 

timeliness 


/ 


Revise  and 
Recycle 


Administer  initial 
evaluation: 

one-to-one 
pilot  test 
foraative  interim 


^     Conduct  group  trial 


I 


Conduct  field-test 

formative  product 
goal  free 


Prepare  final  form 
scripts 
Btoryboards 
visuals 
mast ert ape- 


Operational  tryout 


Analyze  evaluation  data 
program  outcomes 
relationships  and  indicators 
Judgements 
objectives  met 
unexpected  results 
utilization  plan 
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rivea  zro^  in-hou^c  documeiit  jlioii  and  Bainuiu   l^9^'J)  ^  Ine 
iidriativc:  reflectea  the  la  pid  growth  or  ASI  as  a  viaule 
entity. 

The  aoxu  segment  ox  the  diosertaticr  provided  a  detailed 
docurauiit utioa  of  the  kSl  six-puase  ccirse  development  pro- 
cess.    When  necessary  a nu  uppropos,  a^penaices  were  added  to 
pro  viae  rurriicir  clarified  rion  and  for  easy  reference.     As  in 
tlie  preceding  segment,  the  process  wa^  ccnsolxdated  auto  a 
flowchart:  diagrau  of  the  events  leadinq  to  course  completion 
and  i  cplenen  ta  tion  as  showii  in  figure  ^. 

Ihe  linal  segment:  discussea   the   rationale,  aiethodology 
ana  tatulatea  results  of  a  guesrionna ir e  designed   to  further 
verily  and  evaluate  tne  ASx   model  frcm  an  in-nouse 
perspective. 

Cons.lu^ons 

Nine  conclusions  were  generated  as  a  result  of  the 
investigation.     Essentially,    these  are   related  to  the  state 
of  the  art  of  fcraiative  evaluation  as  delineiited  in  Chapter 
II,    rue  moael  deiaveci  ficra  the  theory,   the  ASI  procedure  and 
survey  results  described  in  Chapter  III,  and  the  comparison 
of  the  trfo  moaels  in  Chapter  IV  of  the  cisserta ticn. 

r orij  ative   Ey  alu  at  i^ n  , r te _ o f _ tji e. ,JiZt 

2oa£  conclusions  were  generateu  ixca  tne  literature 
review  in  Chapter  II.     They  are  as  fellows: 
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PHASE  I:    PROJECT  IHITIATIOH 


Identify  Problem 

-verify  field  reports 
-survey  potential  market 


Describe  Problem  and 
Setting 

\ 

-consolidate  analysis  data 
-determine  curriculum  and 
scope 

-determine  curriculum 

objectives 
-identify  primary  audience 
-verify  potential  resources 
-recommend  program 

development 


Analyze  Problem 
and  Setting 

-survey  research  reports 
-survey  potential  clients 
-attend  vorkshops/seminars 
-survey  content  or  training 

experts 
-survey  potential  trainees 
-analyze  internal  and  external 

training  products 
-determine  marketing  goals 

and  objectives 


Develop  Product 
Assessment  Package 

-identify  problem 
-describe  problem 
-describe  problem  nature 
-primary  audience  characteristics 
-course  analysis  (existing) 
-potential  marketing  goals 

and  objectives 
-solution 

-curriculum  scope  and  objectives 
-proposed  sequence 
-available  resources 


GO/RO  GO  DBCISIOH 


 *  

Project  Initiation 

-choose  developer 

-prepare  product  description 

-develop  purpose  and  scope 

for  each  course  and  module 
-recommend  course  developer 

preparation  plan 
-select  and  contract  external 

authors  (if  necessary) 
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PHASE  II:    COURSE  ANALYSIS  ATO  DESIGN 


Target  Description 

-consolidate  data  ' 
-locate  resident,  content 
and  training  experts 


Cotxrse  Content  Oyerrlev 
Perform: 

-reviev  of  product 

assessment  data 
-analyze  existing  naterial 
-literature  rcrlcv 


Identify: 

-training  needs 
-relevant  cognitive  data  , 
-releTont  skill  data 
-general  task  description 


Consolidate  Data 


SPECIFY  OBJECTIVES 


Generate  General 
Course  Objectives 

-identify  specific 
skills  and  knovledge 

-specify  entry  and 
terminal  expectations 


Generate  Detailed 
Course  Objectives 

-state  in  performance 
terms 

-state  subobjectives 
in  performance  terms 

-determine  performance 
criteria 


DEFINE  CONTENT 

Generate  Topical 

Outline 

-identify  topics 

-identify  subtopics 

-sequence  topics  and 

subtopics 

-correlate  vlth 

general  objectives 

Generate  Detailed 

Topical  Course  Outline 

-expand  general  outline 

-sequence  course 

-correlate  vith 

performanc 

e  objectives 

ERIC 
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DEVELOP  COURSE  STRATEGY 


Analyze  Course  Requirements 

-develop  criteria  for 

final  exaxoinatlon 
-develop  performance 

objectives 
-Identify  terminal  and 

Implementing  objectives 


Develop  Instructional 
Strategy 

-develop  training  hierarchy 
-vrlte  final  exaa  items 
-specify  instructional 
tactic  for  each  objective 


Word  Processing 
-input 

-proof  output 


Develop  and  Document 
Media  Strategy  <• 

-identify  media 
-document  special 
production  needs 


Develop  and  Document 
Packaging  Strategy 

-identify  number  and 
type  of  course  pieces 

-describe  any  special 
packaging  considerations 


1 

f 

Develop  Video  and 
Audio  Treatments 

REVIEWS  AND  REVISIONS 


SPM  Review 

-reviews  and  approves 

all  materials 
-begins  search  for 

Beta  teat  site 


Quality  Control  Review 

-distribute  copies 

to  reviewers 
-review  materials 
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Quality  Control 
Debriefing 

-quality  control  committee, 
product  manager »  SPM«  TSM»  and 
others  as  necessary 


Quality  Control 
Not  Approve 


RE7ICI0NS 


Hevlse  Content /Instructional 
Design 

-Input  corrections 
-SPM  approval 


Run  A 
Tes 

Ipha 
t 

Present  Results 
to  Quality  Control, 
Committee 

f 

Quality  Control 
Approval 

r 

Director  of 
Product  Development 
Approval 
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PHASE  III:    MODULE  CONTENT  DEVELOPMENT 


DEVELOP  CONTENT  NARRATI\'E 


Planning 

-rcTlev  schedule  and  budget 
-plan  actirities  and  deliverables 
-arrange  for  optional  alpha 

test  (if  necessary)  vith 

toaster  performer 


Generate  Content  Narrative 

-develop  draft  for  each  atodule 
-consult  M*ith  Technical  Senior 

Manager  and  content  expert 

as  necessary 
-review  and  revise  content 


Alpha  Test  (Optional) 

-assemble  draft 
-.administer  test 
-collect  results 
-interview  alpha  test  person 
-perform  revisions  based  uponi 
results  j 
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PHASE  IV:    MEDIA  DEVELOPMENT 


Planning 

-select  production  teaa 
-determine  riauals 
-estal)li8h  priorities 


Scripting 

-develop  production 

ready  seripta 
-rideo  treatments 
-audio  treatments 


Rerieva  and  Herisions 

-Senior  Product  Manager  reriev 
-Product  Manager  rerieif 
-Quality  Control  Committee 

reriev 
-revisions  based  txpon 

previous  reviews 


Alpha  Test 

-find  representative  student 
vlthin  or  outside  of  the 
corporation 
-administer  test 
-evaluate  results  and 
revise  based  upon  results 


Review 

-review  and  approval  based 
upon  results  by  Director 
of  Product  Development 
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PHASE  V:    MEDIA  PRODUCTION 


Planning 

-schedule  resoxirceB  * 

-review  budget  and 

 ► 

schedule 

Generate  Master 
Materials 

-Tideocassettes  or  tapes 
-audiotapes 
-student  guides 
-ooordinator  guides 


Generate  First  Production 
Run  of  Materials 

->check  for  errors 

-run  Beta  set  -  ainimum 

audience  of  fifteen 
-run  complimentary  set 

for  content  expert 


Review  First 
Production  Run 


Produce  Releases 

-Production 
-Beta  test 


PHASE  VI:    BETA  TESTING  , 


Planning 

Testing 

-contact  company 

 P 

-pretest 

-select  students 

-annotate 

-contract  time,  place 

-final  examination 

-forward  materials 

-questionnaire  and  debrief 

Final  Report 

-Review  Beta  Test  data 


Implement  Course 


Revise  Course 
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1.  Foruative  evaluduioa  tiieorv   vas  based  upon  the 
audiovisual  instjcuctioa  uoveaient  oi  zi.e  lJ20*s  and  tae  psy- 
ciiouetric  laoveaent  oi  the  lyjO's, 

2,  Practical  uses  cr  i  ormati  ve  evaluation  was  aerived 
rrom  rtsedicn  ccxiductea  in  the  ariued  icrces  durinq  Worlu  War 
XI. 

*  3.     Foraiative  evaluation  theory  racdej.s  were  not  de*- 

i 

veloped  until  thje  late  19oO»s. 

4,  The  industrial  and  inilitary  dciraias  did  not  provide 

I 

many  codels  of  lomatlve  evaluation. 

JL  he  AS  I  F  recess  Van  d  .  i1c?d_gl 

The  rirt  h  aud  sixth  conclusions  were  baif»=d   upon  tne 

\ 

rasuxts  o±  Chapter  III.     They  are  as  follows: 

5.  Ihe  A  SI  model  rv;fxected  tht  corporation's  desire  to 
present  a  syoteoatic  approach  to  the  aevelopuient  and  evalua- 
tion or  traiainq  luatecials. 

o.     Ihe  employees  of  ASI  did  not  always  aqree  with 
ASl's  metncd  or  course  development  and  evaluation  based  upon 
tne  results  of  the  survey  detailed  in  Chapter  III. 

'J? n e  T Ji GO r Y_iJo del/A^I_ rl o d e i_ Co jajgar i so c 

Ihe  sevenths   eignth^  anu  ninth  ccnclusions  are  based 

upon  tne  coiupar iso n  o £  the  theory  aodel  in  Chapter  II  and 

i 

the  ASI  a^ccibi  in  Chaptei:  111.     The  three  concrusions  are  as 
foliovis; 
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7.     On  tLe  basio  oi  ^ne  findiiiQs  iii  ChapteL  IV^  tne 
theory  uoaei  cuula  have  beuc^rittcid  tiCui  iaterfdce  with  the 
ASI  uiouoi,     The  Go/No  Go  decisioa  poiit  iii  the  A5I  model  was 
oae  OL  tao  more     iqnifi caut  artds  in  which  the  theory  aodel 
would  rec6iv<^  sUDStaatial  benefit,     A  second  benetit  found 
in  tne  ASI  models  bui:  not  in  triti  theory^  is  the  step  of 
ideu*tilying  needso 

Another  coaciu  sion  gleaned  1 xc  e  xhe  results  of 
Chapter  IV  was  that  tae  taecry  ucdel  and  the  A51  model  were 
similar  in  significant  areas.     ihis  was  most  apparent  in  the 
iiapleineat  otion  and  evaluation  ST.age,   cs  the  steps  followed 
in  each  ox  tht  models  were   roucjaly  equivalent  to  one 
another. 

The  ninth  conclusion  ox   this  study  concernea  xhe 
ASI  d-3sign.     ba^ed  upon  the  results  ox  Chapter  IV  ^  there 
were  a  number  oi  steps  within  tne  ASI  ffcdel  which  could  have 
borieiitteu  from  the  formative  evaluaticn  theory  model. 

The_CoiMJinjd_iorna^ 

Using  the  dar  a  and  incorporating  tii€  above  conclusions^ 
a  comxination  of  the  theory  kodi:l  and  the  ASI  luoael  was 
aeveloped.     I  he  result  is  shown  in  Figure  5.     The  advantage 
DX  this  luodcl  is  that  it  is  based  cn  lesearcn  theory  aud 
provtn  applicability  in  the  xiexd . 
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A>IALYSIS  OF  EVALUATION  REQUIREMENTS 


Evaluation  Problem 

-  Identify  problem 

-  define  problem 

-  describe  problem 


Develop/Plan  Evaluation 
Activities  Package 

-  project  decision 

alternative 

-  develop  decision 

criteria 

-  define  policies 

-  Identify: 

-  longitudinal 

effects 

-  .hlch  payoff  trans- 

actions 

-  entry-level  criteria 

-  prioritize  needs 

-  select  needs  for  action 

-  abstract  project 

-  determine  Intents 
"  proposed  sequence 


Analyze  Problem  and  Setting 
'  needs  assessment 

-  survey  research  reports 

-  attend  workshops/seminars 

-  focus  evaluation 

-  Identify  goals 

-  Identify  program  components 

-  consolidate  data 

-  verify  potential  resources 

-  recommend  program  development 


Go/No  Go  Decision 


Evaluation/Project  Initiation 

-  choose  devel  ..per/ev&luatlon 

8peclal:lst 

-  deveT;^p  puvpo&a  and  scope 

-  analvze  -..  ronment 
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DESIGN  OF  THE  EVALUATION  SYSTEM 


Identify  Objectives 
according  to: 

-  audiences 

-  educational  phllosf 

-  subject  matter 

-  rationales 

-  staff  alms 

-  specific  skills  and 

knowledge 

-  entry  and  terminal 

expectations 


Develop  Evaluation  Strategy 

-  task  analysis 

-  determine  course  requirements 

-  performance  objectives 

-  training  hierarchy 

-  media  and  packaging  strategy 

-  special  considerations 


Determine  Information  Stages 

-  collection 

-  organization 

-  analysis 

-  reporting  results 


Determine  Statistical  Method 

-  descriptive 

-  predictive 

-  ANOVA  or  ANCOVA 

-  canonical  correlation 

-  multiple  discriminant 

-  path  analytic 

-  non  parametric 


Reviews 

-  Quality  control  review 

-  SPM  review 

-  review  prior  to  evaluation 

Implementation 


594 

EKLC 


IMPLEMENTING  THE  EVALUATION  DESIGN 


Develop  Content 
"  planning 

-  draft  materials 

-  revise  as  necessary 


Develop  Media 

-  planning 

-  scripting 

-  video  and  audio 

-  treatments 


Pre-Evaluation; Activities 

-  determine  dimensions 

-  review  prior  to  evaluation 

-  conduct 

-  self  evaluation 

-  expert  appraisal 

-  internal  review 

-  develop  natural  language 

questions 


Check  Evaluation  Desig" 

-  pervasiveness 

-  reliability 

-  validity 

-  credibility 

-  timeliness 


Administer  Initial  Evaluation 

-  one-to-one 

-  alpha  test 

-  pilot  test 

-  formative  interim 


Review  and  Revise 
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 *  

Generate  First  Production  Run 
"  check  for  errors 

-  produce  releases 
~  visuals 

-  masters 

  Conduct  Field  Test 

"formative  product" 
"goal  free" 


Conduct  Group  Trial 


Operational  Tryout 
or  Beta  Test 

-  planning 

-  select  students 

-  testing 

-  final  report 


Analyze  Evaluative 
Data 

-  program  outcomes 

-  relationships  and 

Indicators 

-  judgements 

-  objectives  met 

-  unexpected  results 


Implement  Course 


^         Revise  Con 
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Ihe  results  of  this  study  yielded  thrt:e  recoLimeiidat: 
i-or  ruture  reoeaiTch  or  applications.     They  are  as  follow: 

1.     Cue  recoiameadat ion  tor  use  cl-  the  results  would 
that  the  historical  development  presentea  in  Chapter  IX 
pro  vides   an  iuimediate  understanding  c  1  f  crmative  tjva  luat: 
Enouxju  intoroation  was  provided  to  eiatle  the  researcher 
practxt.ioner  to  nave  a  sclid   understandinq  of  xhe  foriuat: 
evaludt-icn  process  and  its  roots  in  the  educational^  indi 
tridl  and  military  Jomains. 

^.  A  second  r  ecommencat  ion  fcr  use  of  this  study  K( 
tollow  the  ccrrparison  and  contrast  of  lepreisent ative  sys- 
teiiis.  Initially^  a  move  toward  stanuardizinq  the  terms  < 
process  of  formative  evaluation  could  te  establiijhed.  St 
onaly,  oxistinq  or  future  systems  could  re  compared  viith 
modified  by  the  formative  evaluation  theory  model  develoi 
in  Chapter  II, 

3.     A  third  r ecoiumendat ion  ror  luture  use  ox  the  sti 
would  be  to  use  the  results  of  Chapter  II  as  a  text  in  aj 
evaluation  curriculum  or  course  ror  cuiriculum  aeveloper: 
c urr  iculum  ev  aluator:D/   ins  t  luctional  cesi qn  spec ia lists, 
anyoi.e  involved  in  tae  production  of  instructional  packat 
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i<  ^  c  cai  in  jn  a  at  jgiL  s  _  x  or  Fu  tui€  ^  e  s  e  ai:  c  b 
The  direct  ions  oi  iutara  researci  ii:  terms  ot  tais 
particular  stuay  are  aa  li  y  and  varied,     Ihese  laay  ha  rakcn  a^ 
bases  ror  research  in  the  thtsore  ticaj.  as  well  as  the  prac- 
tical QOia  ains, 

!•     The  irost  ircpcrtant  direction  ior  future  research 
wouj.»d  te  to  pfcrforin  a  fcrmative  evaluation  of  any  instruc- 
tional program  or  package  with  the  ccnhined  model  presented 
in  Chapter  V, 

2,  ScConaiV/   the  thecretical  wcdei  developed  in  Chap- 
ter 11  iuay  provide  tua  basis  for  aadi  tional  coinparisoiiS  vith 
T:ne  roriuative  evaluation  procedures  pxescrted  in  ether  r  u- 
ture  laodels.     Tins  would  only  enhance  tie  literature  avail- 
abl^i  cn  foiiiiative  evaluation, 

3,  Thirdly /  another  airection  for  rurtner  research 
would  to  te  to  design  and  execute  a  ccst/tenefit  experimen- 
tal study  involving  tne  theoretical  ncdel  in  Chapter  II  or 
the  combined  acdel  in  Chapter  V.     This  iicula  deteriDine  wheth 
er  the  aaued  expense  of  rormative  evaluation  is  worth  the 
cos  t , 

4,  A  fourth  area  ox  potential  study  would  be  to  expand 
and/or  modify  thj  theoretical  model   presented  in  Chapter  II 
as  well  as  the  combined  inodel  presented  in  Chapter  V,  This 
would  coincide   with  estatlishinq  a  standdid  formative 
evaluation  mouel  sultan  j.e  for  use  iii  a  variety  of  settings. 
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A  filth  drea  ox  potential  iatudv  wouxd  be  to  coiupare 
and  contrast  the  formative  evalaatioc  ncc^dures  of  otuer 
corporaxions  involved  in  pcoaucinq   traininq   packaqes  wit  a 
the  taooretical  model  devtilcped  in  Chapter  II. 
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TO  THE  EDUCATIONAL  RESOURCES 
INFORMATION  CENTER  (ERIC)." 


This  brief  paper  will  reflect  upon  two  things.  The  first  is 
educational  technology  research  and  its  present  state.  The  second 
is  the  role  of  ECTJ.    The  paper  is' not  to  be  construed  in  any  way 
as  official  Journal  editorial  policy,  but  rather  as  some  personal 
reflections  about  where  we  are  and  where  should  be  be  going. 

Dare  I  begin  with  a  definition?  I  think  it  might  be  useful. 
For  me ,  educational  technology  is  centrally  concerned  with 
design,  with,  as  Simon  (I969)  puts  it,  the  main  focus  on  the 
optimization  of  alternative  paths  of  action,  I  do  not  think  that 
this  definition  is  in  any  way  heretical.  It  is,  of  course,  very 
close  to  a  definition  of  technology,  given  by  Galbraith  (1967): 
"The  systematic  application  of  scientific  or  other  organized 
knowledge  ■  to  practical  tasks."  This  definition  suits  me  well. 
Galbraith  and  Simon  are  essentially  saying  the  same  thing.  That 
we  have  to  make  the  best  possible  decisions  for  action,  given  a 
particular  set  of  circumstances;  and  that  we  have  to  have  a  body 
of  knowledge  to  guide  us._While  this  approach  to  what  we  do  in 
o\,ir  fifil(j  is  clearly  rooted  in  positivism  and  determinism,  ^  the 
limitations  of  which  are  becoming  increasingly  apparent  to 
educators,  it  is  nonetheless  the  paradigm  that,  for  now, 
continues  to  dominate  our  activities  as  educational 
teclinologists. 
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Ji^catior.al  technologists  succeed  in  vjhat  they  do  to  the 
extent  that  they  have  access  to  and  understand  the  body  of 
"scientific  or  other"  kr-^wledge  that  underpins  our  field,  to  the 
extent  that  they  accuratel,  nalyze  and  understand  the  practical 
tasks  they  are  expected  to  deal  with, _and  to  the  extent  that^ they 
are  aware  of  and  can  use  the  '  systematic"  procedures  that  lead  to 
the  best  decisions.  Educational  Technology  is  an  eclectic,  even 
better  a  systemic  discipline  in  that  the  strength  of  the 
discipline  is  determined  by  the  strength  of  its  weakest 
component.  In  other  words,  without  a  sound  body  of  knowledge, 
techniques  for  analysing  practical  tasks,  or  a  set  of  optimizing 
procedures,  the  whole  endeavor  grinds  to  a  halt.^  The  weakest  one 
of  these  three  components  will  determine  the  strength  of  the 
entire  discipline  and  the  success  of  the  design  process. 


What  is  the  body  of  ^  scientific  knowledge  that  we  apply 
systematically  to  practical  tasks?  My  position  is  that  it  is_ 
instructional  theory.  However,  when  you  consider  vhat  I  believe 
to  be  valid  sources  of  instructional  theory,  you  will  realize 
that  my  position  is  not  as  narrow  as  you  m^ght  first  have 
thought.  Instructional  theory  can,  of.  course,  be  built  from 
experimentation,  either  directly  from  controlled  studies  of 
instruction,  or  indirectly  from  controlled  studies  of  learning. 
Implied  here  is  a  fundamental  distinction  between  theories  of 
learning,  which  are  descriptive,    and    theories   of  instruction, 
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which  are  prescriptive.  On  the  other  hand,  theories  of 
instruction  can  be  built  from  naturalistic  observation  of  v;hat 
goes  on  when  students  learn  and  instructors  teach,  in  classrooms 
or  wherever.  (A  point  to  be  made  here  is  that  the  impending  shift 
from  experimental  to  naturalistic  research  methods,  while 
influencing  instructional  theory,  will  not  necessarily  change  the 
deterministic  pratices  of  designers.  Ihe  way  in  which  knowledge 
is  derived  does  not  effect  the  use  to  which  it  is  put.) 

As  the  body  of  knowledge  contained  in  instructional  theory 
grows,  there  are  two  major  points  that  are  becoming  increasingly 
clear.  The  first  is  that  media  and  communications  technologies, 
as  delivery  systems,  do  not  make  one  iota  of  difference  to 
learning.  What  do  make  a  difference  are  features  of  the  formats 
in  which  information  is  cast,  and  instructional  methods,  which 
are  both  mostly  indepedent  of  media,  but  which  both  engage 
cognitive  processes  that  do  have  an  impact  on  learning-  Ihe 
second  point  is  that,  because  human  behavior  is  so  utterly 
unpredictable,  the  discovery  of  the  optimal  method  of  instruction 
is  well  nigh  impossible.  We  can  certainly  improve  the  ways  ir* 
which  we  select  th  ;  best  method  for  the  given  circunstarces. 
However,  the  chances  are  that  this  method  will  not  apply  in  other 
situations.  As  Clark  (1983)  pointed  out  recently,  we  usually  deal 
with  sufficient  conditions  of  learning ^  not  necessary  conditions. 
This,  of  course,  points  to  a  weakness  in  instructional  theory  in 
its  current  state.  Ideally,  instructional    theory    should  embody 
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Taecessary  coraditions  of  learning.  But  for  now  we  will  have  to 
make  do  with  what  we  have. 

In  addition  to  instructional  theory,  derived  from  controlled 
experiments  and  from  observation  of  learning  and  instruction, 
educational  technologists  also  build  theories  of  design.  These 
are  concerned  with  analyzing  and  describing  the  "practical  tasks" 
faced  by  educational  technologists,  and  with  techniques  for 
decision-making.  Interestingly,  techniques  of  task  and  learner 
analysis  are  intimately  tied  to  developments  in  cognitive 
approaches  to  instructional  theory.  As  our  picture  of  how  people 
learn  is  gradually  pieced  together,  so  •  our  knowledge  of  how 
students  learn  and  use  algorithms  and  how  this  is  affected  by  the 
skills  and  strategies  they  bring  to  bear,  is  improved.  The  deeper 
we  dig  into  cognitive  processes  and  skills,  the  harder  it  becomes 
to  separate  content  from  mental  skill,  task,  from  learner 
analysis.  Instructional  research  informs  instructional  design. 

Instructional  decision-making,  on  the  other  hand,  is 
considerably  complicated  by  advances  in  theory.  When  I  look  at 
media  selection  (method  selection?)  models,  they  are  all 
extremely  oversimplified  in  the  face  of  what  we  now  know  about 
learning  and  instruction.  I  should  add  that,  in  their  recent 
book.  Reiser  and  Gagne  (1983)  recognize  this,  and  imply  that 
while  a  selection  model  will  make  life  easier  for  designers  of 
certain    kinds    of    tasks,    it  i>all  not  make  life  perfect.    To  do 
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this  would  require  that,  indeed,  instructional  theory  describe 
all  the  necessary  conditions  of  all  types  of  learning,  a 
situation  which  is  a  long  way  off  in  the  future,  if  we  are  ever 
to  achieve  it. 

To  sunmarize,  then,  we  are  still  flying  by  the  seat  of  our 
pants  to  a  degree.  Our  three  tasks  of  building  instructional 
theory,  of  developing  techniques  for  analysis  of  practical  tasks, 
especially  learners  and  cognitive  processes,  and  of  developing 
.  effective  decision-making  techniques  still  have  a  long  way  to  go. 
We  are  at  least  off  the  ground.  But  we  have  still  have  to  climb 
to  cruising  altitude. 

ECU  has  a  contribution  to  make  in  the  dissemination  of 
information  about  all  three  of  our  tasks,  "me  journal  publishes 
articles  that  contribute  to  instructional  theory,  either  by 
reporting  experiments  or  by  putting  forward  theoretical 
positions.  It  also  publishes  articles  on  design  theory,  that  is 
on  how  we  analyze  practical  tasks  and  how  we  make  instructional 
d.-eisions.  However,  to  date,  there  has  been  a  tendency  to  publish 
far  more  articles  of  the  instructional  theory  type  than  of  the 
other  types. 

There  are  a  nuniber  of  reasons  for  this.  First,  there  is 
still  the  perception  that  for  purposes  of  promotion  in 
universities  the  empirical  "hard  science"  paper  is    somehow  more 
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respectable  than  papers  to  do  with  practice.  However,  what  Schon 
(1983)  has  dichotomized  as  "Technical  rationality"  and 
"Reflection  in  action"  are  both  equally  important  ingredients  in 
our  profession.  Unfortunately  professional  schools  are  usually 
low  on  the  totem  pole  in  universities,  which  means  that  it  will 
take  time  and  effort  to  get  contributions  to  practice  recognized 
as  equal  in  value  to  contributions  to  theory. 

Second  is  the  vicious  circle  in  which  journals  tend  to  get 
caught  up.  A  journal's  editorial  policy  is  inferred  mainly  from 
what  people  see  it  publishing,  and  only  minimally  from  policy 
statements  that  it  prints,  usually  under  "Instructions  to 
authors" .  I  think  ECU  is  seen  to  be  a  place  to  publish  articles 
contributing  to  instructional  theory.  This  is  certainly  true  if 
the  proportion  of  manuscripts  that  are  submitted  is  anything  to 
go  by.  It  is  not  that  articles  in  the  other  categories  (analysis, 
design  and  so  on)  are  rejected  more  frequently  by  the  reviewers. 
We  just  do  not  get  them.  I  would  like  to  add  a  word  about 
articles  on  computer  applications  to  education.  We  should  be 
publishing  papers  in  this  area.  But  to  date  we  have  not  received 
one  good  report  of  a  computer  study  or  project.  I  find  this 
surprising,  if  not  alarming.  Again,  I  am  sure  this  is  because  we 
are  not  thought  of  as  a  "computer  journal" . 

As  a  final  exanple,  we  have  received  a  number  of  manuscripts 
about     naturalistic    research   methods.    However,    we    have  not 
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received  one  good  report  of  a  study  that  used  them!  Either  lots 
of  people  are  talking  about  these  methods,  and  no-one  is  doing 
naturalistic  research.  Or  people  are  sending  their  manuscripts 
elsewhere.  I  suspect  the  latter,  again  because  we  are  not  seen  to 
be  the  place  to  publish  naturalistic  studies,  I  should  also  add 
that  a  lot  of  people  (until  recently  myself  included)  still 
consider  such  research  to  be  less  rigorous  and  of  a  lesser 
quality.  There  is  work  to  be  done  here,  and  I  think  RTD  has  an 
important  role  to  play. 

If  ECU  is  seen  to  be,  and  by  virtue  of  that  fact  actually 
is  a  journal  that  reports  mostly  instr?>Dtional  theory,  then  how 
is  it  different  from  other  journals  that  do  this,  such  as  JEP?  t 
think  in  two  ways.  The  first  is,  ironically,  the  residue  fr-om  th^. 
"Audio-Visual"  orientation  that  our  field  used  to  have.  The 
research  we  publish  tends  frequently  to  investigate  the  "message 
format"  variables  of  instructional  theory.  We  carry  a  lot  of 
articles  on  pictures,  visualization,  audio,  and  so  on.  So,  for 
people  who  want  to  read  about  or  publish  a  paper  on  how  the  form 
given  to  information  affects  learning,  ECU  is  the  first  place  to 
turn . 

The  second  difference  between  ECU  and  other  journals  is  the 
degree  of  emphasis  given  the  extension  of  results  into  the  design 
process.  I  have  noticed  that,  for  the  most  part,  our  authors 
tend  to  pay  attention  to  application  of   their    research   to  the 
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practical  tasks  of  education.  This  is  encouraging,  because  it 
has  within  it  the  germ  of  that  shift  from  the  theoretical  to  the 
practical,  from  "Technical,  rationality"  to  "Reflection  in 
action",  that  I  alluded  to  above.  I  am  particularly  pleased  to 
see"  an  author  do  a  super  job  of  presenting  a  study  conducted  in  a 
"real  world"  setting,  and  saying  so.  Of  course  there  is  a 
trade-off  of  internal  for  external  validity.  But  provided  this  is 
made  known  to  the  readers  with  all  frankness,  then  I  have  no 
problem  with  it.  As  we  see  more  naturalistic  research,  this 
matter  will  crop  up  moret^often. 

My  optimism  about  the  future  of  the  Journal,  after  almost  a 
year  as  its  editor,  is  average  to  above  average,  though  not 
wildly  positive.  This  note  of  caution  has  its  roots  in  what  I 
have  just  said:  we  are  not  publishing  enough  articles  in  the 
analysis  and  design  categories  which  makes  our  field  unique;  we 
are  not  doing  so  because  we'  we  are  not  getting  the  manuscripts; 
people  are  not  submitting  the  manuscripts  because  we  are  seen  to 
be  primarily  a  journal  of  instructional  theory,  and  bec-ause 
papers  of  this  type  are  not  thought  of  as  highly  as  basic 
research  papers  in  academic  communities.  Let  me  add  straight 
away  that  there  is  nothing  wrong  with  us  publishing  instructional 
theory.  I  just  feel  that  we  need  to  publish  more  in  design  and 
application  as  well. 

I    have    ignored  the  type  of  manuscript  that  we  also  receive 
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from  time  to  time  to  do  with  the  scociological  aspects  of  our 
discipline.  I  am  referring  to  articles  on  the  social  impact  of 
educational  technology,  the  v*iole  area  of  innovation  and  change, 
organization  and  management,  the  history  of  our  field,  and  so  on. 
I  must  apologize  if  in  leaving  these  areas  to  last  I  have  seemed 
to  belittle  them.  That  is  not  my  intention.  It  seems  that  any 
discipline  will  do  well  to  examine  itself  and  its  impact  from 
time  to  time.  ECU  must  support  these  efforts.  But  again,  we 
receive  far  fewer  submissions  of  papers  dealing  with  these  topics 
than  of  papers  on  other  topics.  That  is  a  fact  over  which  we-  have 
little  control. 

As  an  editor,  I  often  wish  I  could  make  people  write  and 
submit  manuscripts e  Of  course,  we  have  the  annual  review  papers, 
funded  by  ERIC  at  Syracuse.  But  these  do  not  allay  my 
frustration.  An  editor  can  solicit,  can  weadle  and  encourage.  But 
an  editor  cannot  compel.  The  future  of  the  Journal  is  therefore 
in  the  hands  of  the  members  of  AECT  and  of  the  broader  research 
and  development  community  that  feeds  it.  We  must  all  encourage 
these  consituencies  to  allow  us  to  publish  what  it  is  they  are  up 
to.  The  journal,  after  all,  has  a  responsibility  to  communicate 
to  members  of  AECT  the  latest  ideas  and  discoveries  of  the  field. 
These  may  not  be  occuring  under  tne  auspices  of  people  who  think 
of  themselves  as  educational  technologists  before  all  else.  But 
they  are  doing  work  of  importance  to  our  profession  and    we  must 
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83/156 

SHERIFF,  D.E 

80/445 

KREY,  C.L. 

83/441 

NEWELL,  K.J. 

83/156 

WILLIAMS,  J. A. 

80/445 

CANELOS,  J. 

80/85 

JOSEPH,  M.R. 

83/370 

LA  CROIX,  P. 

83/370 

WINN,  B. 

79/580 

TYSON,  L. 

82/519 

ROBINSON,  R.S. 

81/535 

RABURN,  J. 

82/519 

SIMONSON,  M.R. 

81/586 

BRODY,  P.J. 

83/96 

BECKER,  A. 

80/55 

RANCOURT,  R. 

81/486 

DIONNE,  J. P. 

81/486 

HEDBERG,  J.G. 

79/244 

WISE,  R.E. 

82/671 

SEWELL,  E.H. 

79/496 

JOSEPH,  J. 

80/311 

WHITAKER,  J. 

80/569 

SULLIVAN,  H. 

80/569 

DUCHASTEL,  P. 

81/137 

HORTIN,  J. A. 

84/240 

MOSLEY,  M.L. 

83/707 

LAMBERSKI,  R. 

80/98 

CHISWELL,  J. 

80/98 

STORY,  N.O. 

83/707 

RAGAN,  T. 

84/433 

ESQUE,  T. 

84/394 

KENNEDY,  P. 

83/394 

NOVAK,  J. 

83/394 

TAYLOR,  W. 

83/125 

CANELOS,.  J. 

83/125 

ALTSCHULD,  J. 

83/125 

SEWELL,  E.H. 

7^7496 

TAYLOR,  W. 

81/88 

CANELOS,  J. 

81/88 

WINN,  W. 

80/646 

JENNINGS,  T. 

80/280 

FRENCH,  M.,- 

84/17R 

BERBEKAR,  R. 

83/736 

657 


DESCRIPTOR 

AUTHOR'S  NAME 

YR/PAGE 

INSTRUCTIONAL  DESIGN 

KOETTING,  J.R. 

84/307 

INSTRUCTIONAL  DESIGN 

BOVY,  R.C. 

81/35 

INSTRUCTIONAL  DESIGN 

SIMONSON,  M. 

79/521 

INSTRUCTIONAL  DESIGN 

WILLIAMS,  J. A. 

84/563 

INSTRUCTIONAL  DESIGN 

DODGE,  B. 

80/lb6 

INSTRUCTIONAL  DESIGN 

BRANSON,  R.K. 

79/602 

INSTRUCTIONAL  DESIGN 

JACKSON,  A. 

83/736 

INSTRUCTIONAL  DESIGN 

GRABOWSKI,  B. 

82/46 

INSTRUCTIONAL  DESIGN 

MARTIN,  N.N. 

79/321 

INSTRUCTIONAL  DESIGN 

GENTRY,  C. 

81/147 

INSTRUCTIONAL  DESIGN 

REIGELUTH,  CM. 

79/100 

INSTRUCTIONAL  DESIGN 

SMITH,  P.L. 

84/487 

INSTRUCTIONAL  DESIGN 

TURNER,  P. 

79/321 

INSTRUCTIONAL  DESIGN 

KERR,  S.T. 

409 

INSTRUCTIONAL  DESIGN 

MELLON,  C.A. 

82/453 

INSTRUCTIONAL  DESIGN 

WINN,  B. 

83/736 

INSTRUCTIONAL  DESIGN 

REID,  G.A. 

81/509 

INSTRUCTIONAL  DEVELOPMENT 

SHERIFF,  D.E. 

80/445 

INSTRUCTIONAL  DEVELOPMENT 

BECKWITH,  D. 

83/1 

INSTRUCTIONAL  DEVELOPMENT 

WILLIAMS,  J. A. 

80/445 

INSTRUCTIONAL  EFFECT 

DWYER,  F.M. 

82/15 

INSTRUCTIONAL  EFFECT 

DWYER,  F.M. 

83/203 

INSTRUCTIONAL  EFFECT 

DE  MELO,  H.T. 

82/40 

INSTRUCTIONAL  EFFECT 

LAMBERSKI,  R.J. 

82/64 

INSTRUCTIONAL  EFFECT 

DE  MELO,  H. 

83/203 

INSTRUCTIONAL  EFFECT 

DWYER,  F.M. 

82/60 

INSTRUCTIONAL  EFFECT 

ARNOLD,  T.C. 

82/15 

INSTRUCTIONAL  EFFECT 

JOSEPH,  J.H. 

79/380 

INSTRUCTIONAL  EFFECT 

DWYER,  F.M. 

82/40 

INSTRUCTIONAL  EFFECT 

JOSEPH,  J.H. 

82/60 

INSTRUCTIONAL  INNOVATION 

HEDBERG,  J.G. 

79/244 

INSTRUCTIONAL  MANAGEMENT 

BRUCE,  K.L. 

84/331 

INSTRUCTIONAL  MANAGEMENT 

MCCOMBS,  B.L. 

84/331 

INSTRUCTIONAL  MEDIA 

COOK,  S. 

82/439 

INSTRUCTIONAL  MEDIA 

LEVIE,  W.H. 

80/201 

INSTRUCTIONAL  MEDIA 

KLOOCK,  T.R. 

82/439 

INSTRUCTIONAL  MEDIA 

FLEMING,  M. 

80/201 

INSTRUCTIONAL  MEDIA 

SIMONSON,  M. 

82/439 

INSTRUCTIONAL  MEDIA 

WINN,  B. 

79/580 

INSTRUCTIONAL  MEDIA 

MCLESKEY,  J. 

80/201 

INSTRUCTIONAL  MEDIA 

SIMONSON,  M.R. 

80/473 

INSTRUCTIONAL  METHODS 

MOORE,  D.M. 

81/471 

INSTRUCTIONAL  METHODS 

3R0DY,  P.J. 

84/44 

INSTRUCTIONAL  METHODS 

OXFORD,  j.F. 

81/471 

INSTRUCTIONAL  STRATEGIES 

LA  CROIX,  P. 

83/370 

INSTRUCTIONAL  STRATEGIES 

JOSEPH,  M.R. 

83/370 

INSTRUCTIONAL  SYSTEMS 

YACOBACCI,  P.M. 

82/105 

INSTRUCTIONAL  SYSTEMS 

ALTER,  M. 

82/105 

INSTRUCTIONAL  SYSTEMS 

GOLDSTEIN,  M. 

82/105 

INSTRUCTIONAL  SYSTEMS 

SOLANO.  F. 

82/105 

INSTRUCTIONAL  TECHNOLOGY 

BURTON,  J. 

80/630 

INSTRUCTIONAL  TECHNOLOGY 

WILDMAN,  T. 

80/630 

INSTRUCTIONAL  TECHNOLOGY 

KOETTING,  J.R. 

83/416 

INSTRUCTIONAL  TEXTS 

BRODY,  P. 

80/70 

TNSTRIirTTDNAI    VARTARI  FS 

DWYER,  F.M. 

83/175 

INSTRUCTIONAL  VARIABLES 

DE  MELO,  H. 

83/175 

INTEGRATED  LEARNING  SYSTEM 

GRABOWSKI,  B. 

82/46 

DESCRIPTOR 

AUTHOR'S  NAME 

YR/PAGE 

INTERACTION 

PECK,  M.L. 

83/561 

INTERACTIONS 

DE  MELO,  H. 

83/175 

INTERACTIONS 

DWYER,  F.M. 

83/175 

INTERACTIONS 

JACOBS,  R.L. 

82/396 

ITV 

JOHNSON,  K.A. 

82/404 

ITV 

KELLER,  P.F.G. 

82/404 

LEARNER  CHARACTERISTICS 

MCLESKEY,  J. 

80/201 

LEARNER  CHARACTERISTICS 

LEVIE,  W.H. 

80/201 

LEARNER  CHARACTERISTICS 

FLEMING,  M. 

30/201 

LEARNER  CHARACTERISTICS 

BECKWITH,  D. 

84/17 

LEARNER  INTEREST 

DODGE,  B. 

80/166 

LEARNERS 

FLEMING,  M. 

84/163 

LEARNERS 

BECKWITH,  D. 

83/1 

LEARNING 

TAYLOR,  W. 

84/72 

LEARNING 

MAIN,  R. 

79/267 

LEARNING 

CHEZIK,  M.A. 

82/33 

LEARNING 

HOLLIDAY,  W.W. 

81/715 

LEARNING 

NESBIT,  L.L. 

82/478 

LEARNING 

DWYER,  F.M. 

82/33 

LEARNING 

WILDMAN,  T. 

80/460 

LEARNING 

CANELOS,  J. 

82/183 

LEARNING 

SHERMAN,  T. 

80/460 

LEARNING 

DWYER,  F. 

84/72 

LEARNING 

ALTSCHULD,  J. 

82/183 

LEARNING 

WINN,  W.D. 

81/715 

LEARNING 

CANELOS,  J. 

84/72 

LEARNING 

TAYLOR,  W. 

82/183 

LEARNING  HIERARCHIES 

REID,  G.A. 

81/509 

LEARNING  STRATEGIES 

HANNIFAN,  M.J. 

82/338 

LEARNING  STRATEGIES 

HANNAFIN,  M.J. 

82/325 

LISTENING  COMPREHENSION 

MANN,  R.E. 

79/429 

MAINSTREAMING 

DRESANG,  E.T. 

82/256 

MANAGEMENT 

SPLAINE,  J. 

81/611 

MATCHING  LEARNING  THEORY 

WILDMAN,  T. 

80/630 

MATCHING  LEARNING  THEORY 

BURTON,  J. 

80/630 

MATHEMATICS 

HANNAFIN,  M. 

80/244 

MEDIA 

TORKELSON,  G.M. 

84/534 

MEDIA  COMPETENCY 

ANDERSON,  C. 

80/35 

MEDIA  MATERIALS 

RUSSELL,  A.L. 

82/548 

MEDIA  PROGRAM 

REEVES,  W.J. 

82/360 

MEDIA  PROGRAM 

5ray,  J. 

82/360 

MEDIA  PROGRAM 

HODGES,  Y.A. 

82/360 

MEDIA  SPECIALIST 

MARTIN,  N.N. 

79/321 

MEDIA  SPECIALIST 

BURNELL,  S. 

79/191 

MEDIA  SPECIALIST 

TURNER,  P. 

79/321 

MEDIA  SPECIALIST 

BOWIE,  M.M. 

83/74 

MEDIA  TECHNIQUES 

KERVIN,  D. 

54/253 

MEDIA  TECHNIQUES 

MCLESKEY,  J. 

80/201 

MEDIA  TECHNIQUES 

FLEMING,  M. 

80/201 

MEDIA  TECHNIQUES 

FRENCH,  M. 

84/178 

MEDIA  TECHNIQUES 

LEVIE,  W.H. 

80/201 

MEDIA  UTILIZATION 

HENNIGAN,  T.L. 

82/311 

MEDIA  UTILIZATION 

DRESANG,  E.T. 

82/256 

MEDIA  UTILIZATION 

OXFORD,  J.F. 

81/471 

MEDIA  UTILIZATION 

MOORE,  D.M. 

81/471 

MEDIA  UTILIZATION 

GILBERT,  R.M. 

82/311 

MEDIATED  INSTRUCTION 

CANELOS,  J. 

84/72 

DESCRIPTOR 


AUTHOR'S  NAME 


YR/PAGE 


MEDIATED  INSTRUCTION 

SIMONSON,  M.R. 

82/561 

MEDIATED  INSTRUCTION 

DWYER,  F. 

84/72 

MEDIATED  INSTRUCTION 

TAYLOR,  W. 

84/72 

MEMORY 

EL-GAZZAR,  A.I. 

■  84/127 

MEMORY  STRATEGIES 

HANNAFIN,  M.J. 

81/166 

MEMORY  STRATEGIES 

JONASSEN,  D.H. 

79/364 

MEMORY  STRATEGIES 

CAREY,  J.O. 

81/166 

META-ANALYTIC 

CLARK,  F. 

80/125 

META-ANALYTIC 

ANGERT,  J. 

80/125 

MOTION  CUES 

SAIET,  R.A. 

457 

MOTIVATION 

HAAS,  N. 

84/402 

MOTIVATION 

STORY,  N. 

84/402 

MOTIVATION 

MOSLEY,  M.L. 

84/402 

MOTIVATION 

MOSLEY,  M.L. 

83/502 

MUSIC 

TYSON,  L. 

82/519 

MUSIC 

RABURN,  J. 

82/519 

MUSIC 

BRIDGES,  N. 

82/154 

MUSIC 

MANN,  R.E. 

79/429 

NATURALISTIC  INQUIRY 

MCISAAC,  M.S. 

84/386 

NATURALISTIC  INQUIRY 

BRODY,  P.J. 

84/44 

NATURALISTIC  INQUIRY 

KOETTING,  J.R. 

84/290 

NATURALISTIC  INQUIRY 

SHROCK,  S.A. 

83/682 

NATURALISTIC  INQUIRY 

MELLON,  C.A. 

83/487 

NEEDS  ASSESSMENT 

SPITZER,  D.R. 

79/543 

NETWORKING  ' 

CANELOS,  J. 

81/88 

NETWORKING 

TAYLOR,  W. 

81/88 

NONVERBAL  COMMUNICATION 

HARRISON,  R.T. 

83/776 

NONVERBAL  COMMUNICATION 

GROSSMAN,  J. 

83/776 

OPERATIONAL  ENVIRONMENT 

PARKHURST,  P.E. 

79/88 

PERCEPTIONS 

BURNELL,  S. 

79/191 

PERCEPTIONS 

CARL,  D.L. 

84/99 

PERCEPTIONS 

HOELSCHER,  S. 

84/99 

PERCEPTUAL-MOTOR 

GERLACH,  V. 

80/217 

PERCEPTUAL-MOTOR 

SCHMID,  R. 

80/217 

PERFORMANCE 

BOWIE,  M.M. 

83/74 

PERFORMANCE 

JONASSEN,  D.H. 

80/293 

PERSUASION 

GRABOWSKI,  B. 

80/220 

PERSUASION 

SHRIGLEY,  R. 

80/220 

PERSUASION 

SIMONSON,  M.R. 

81/586 

PERSUASION 

SIMONSON,  M.R. 

83/58 

PERSU'' ^- ION  ■ 

BERRY,  T. 

83/58 

PERSU.  ;  ION 

WELLIVER,  P. 

.  80/220 

PHILO'JPHICAL  FOUNDATIONS 

KOETTING,  J.R. 

83/416 

PHILO -OPHICAL  FOUNDATIONS 

KOETTING,  J.R. 

84/290 

PHILf'..  1PHICAL  FOUNDATIONS 

KOETTING,  J.R. 

84/307 

PHOTOGRAPHY 

MCISAAC,  M.S. 

81/428 

PHOTOGRAPHY 

MCISAAC,  M.S. 

84/386 

PHOTOGRAPHY 

MCISAAC,  M.S. 

83/478 

PICTORIAL  ELABORATION 

ACEVEDO,  C. 

80/1 

LAMBERSKI,  R. 

80/1 

PICTORIAL  RESEARCH 

TANTIBLARPHOL,  S. 

84/499 

PICTORIAL  RESEARCH 

BERRY,  L.H. 

83/46 

PICTORIAL  RESEARCH 

ANGERT,  J. 

■  80/125 

Pir;ORIAL  RESEARCH 

WIECKOWSKI,  T. 

80/594 

PICTORIAL  RESEARCH 

BRODY,  P.J. 

79/351 

PICTORIAL  RESEARCH 

EL-GAZZAR,  A.I. 

84/127 

PICTORIAL  RESEARCH 

BRODY,  P. 

80/70 

DESCRIPTOR 

AUTHOR'S  NAME 

YR/PAGE 

PICTORIAL  REI.LARCH 

MCISAAC,  M.S. 

83/478 

PICTORIAL  RESEARCH 

LEVIE,  W.H. 

81/388 

PICTORIAL  RESEARCH 

HANNAFIN,  M.J. 

84/2.0 

PICTORIAL  RESEARCH 

LEGENZA,  A. 

79/351 

PICTORIAL  RESEARCH 

BERRY,  L.H. 

84/31 

PICTORIAL  RESEARCH 

HUGHS,  L.H. 

84/499 

PICTORIAL  RESEARCH 

LEVIE,  W.H. 

81/388 

PICTORIAL  RESEARCH 

CLARK,  F. 

80/125 

PICTORIAL  RESEARCH 

MCISAAC,  M.S. 

84/386 

PICTORIAL  RESEARCH 

BRODY,  P.J. 

83/96 

PICTORIAL  RESEARCH 

BRODY,  P.J. 

84/44 

PRACTITIONER 

WHITE,  B.H. 

79/144 

PRESENTATION  MODE 

SAVENYE,  W. 

83/668 

PRESENTATION  MODE 

JOSEPH,  J.H. 

83/357 

PRESERVICE  TEACHERS 

SHRIGLEY,  R. 

80/220 

PRESERVICE  TEACHERS 

WELLIVER,  P. 

80/220 

PRESERVICE  TEACHERS 

GRABOWSKI,  B. 

80/220 

PRINCIPALS 

BURNELL,  S. 

79/191 

PRIOR  KNOWLEDGE 

RICHARDS,  B. 

84/446 

PROBLEM  SOLVING 

HORTIN,  J. A. 

8^/240 

PROGRAM  EVALUATION 

SHROCK,  S,A 

83/682 

PROGRAMMED  INSTRUCTION 

MCGRADY,  D.S. 

«4/354 

PROGRAMMED  INSTRUCTION 

J0NA3SEN,  D.H. 

79/3364 

PROGRAMMED  INSTRUCTION 

BRIDGES,  N. 

82/154 

PROSE 

HANNAFIN,  M.J. 

84/220 

PROSE  LEARNING 

MOSEI  Y,  M.'.. 

83/707 

PROSE  LEARNING 

STORY,  N.O. 

n3/707 

PROSE  MATERIAL 

DWYER,  F.M. 

82/33 

PROSE  MATERIAL 

CHEZi;;,  M.A. 

82/33 

PS  I 

JACOBS,  R.L. 

82/396 

PSYCHOEPISTEMOLOGY 

DIONNE,  J. P. 

81/486 

PSYCHOEPISTEMOLOGY 

RAWCOURT,  R. 

81/486 

PSYCHOLOGICAL  PERSPECTIVE 

MARTIN,  B.L. 

83/460 

PUBLICATIONS 

SIMONSON,  M. 

84/118 

PUBLICATIONS 

WINN,  B. 

84/607 

PUBLICATIONS 

D.MONL,  P. 

84/118 

RATE-MODIFIED  SPEECH 

OLSON,  J.S. 

82/483 

RATE -MODIFIED  SPEECH 

BERRY,  L.H. 

82/483 

REINFORCEMENT 

KORZENNY,  S.S. 

81/345 

RELEVANCE 

WHITAKER,  J. 

80/569 

RELEVANCE 

SULLILVAN,  H. 

80/569 

RESEARCH 

LUKOWSKY,  J. 

81/409 

RESEARCH 

CLARK,  F.E. 

82/144 

RESEARCH 

ROBERTS,  D.M. 

79/132 

RESEARCH 

DWYER,  F.M. 

79/20 

RESEARCH 

TORKELSON,  G.M. 

81/664 

RESEARCH 

REID,  G.A. 

81/509 

RESEARCH 

DIMOND,  P. 

84/118 

RESEARCH 

HORTON,  J. A. 

79/140 

RESEARCH 

ANGERT,  J.F. 

79/1 

RESEARCH 

SHEPJFF,  D.E. 

79/140 

RESEARCH 

ANGERT,  J.F. 

82/144 

RESEARCH 

CANELOS,  J. 

82/27 

RESEARCH 

SIMONSON,  M. 

84/118 

RESEARCH 

BERRY,  L.H. 

82/483 

RESEARCH 

RAGAN,  T. 

84/433 

RESEARCH  ■ 

CLARK,  F.E. 
o40 
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